-- Logs begin at Fri 2022-09-02 04:41:40 UTC, end at Fri 2022-09-02 05:40:06 UTC. -- Sep 02 05:09:11.778554 dv-cinder-853910-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 02 05:09:11.786047 dv-cinder-853910-7-smb devstack@keystone.service[81501]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 05:09:11 2022] *** Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: nodename: dv-cinder-853910-7-smb Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: machine: x86_64 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: clock source: unix Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: pcre jit disabled Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: detected number of CPU cores: 4 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: current working directory: / Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: detected binary path: /usr/bin/uwsgi-core Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: your processes number limit is 47680 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: your memory page size is 4096 bytes Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: detected max file descriptor number: 2048 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: lock engine: pthread robust mutexes Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: thunder lock: enabled Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 02 05:09:11.791227 dv-cinder-853910-7-smb devstack@keystone.service[81501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 05:09:11.828254 dv-cinder-853910-7-smb devstack@keystone.service[81501]: Python main interpreter initialized at 0x557bad5679c0 Sep 02 05:09:11.828254 dv-cinder-853910-7-smb devstack@keystone.service[81501]: python threads support enabled Sep 02 05:09:11.828254 dv-cinder-853910-7-smb devstack@keystone.service[81501]: your server socket listen backlog is limited to 100 connections Sep 02 05:09:11.828254 dv-cinder-853910-7-smb devstack@keystone.service[81501]: your mercy for graceful operations on workers is 90 seconds Sep 02 05:09:11.828624 dv-cinder-853910-7-smb devstack@keystone.service[81501]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 05:09:11.828702 dv-cinder-853910-7-smb devstack@keystone.service[81501]: *** Operational MODE: preforking *** Sep 02 05:09:11.828960 dv-cinder-853910-7-smb devstack@keystone.service[81501]: *** uWSGI is running in multiple interpreter mode *** Sep 02 05:09:11.828960 dv-cinder-853910-7-smb devstack@keystone.service[81501]: spawned uWSGI master process (pid: 81501) Sep 02 05:09:11.829168 dv-cinder-853910-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 02 05:09:11.830359 dv-cinder-853910-7-smb devstack@keystone.service[81501]: spawned uWSGI worker 1 (pid: 81514, cores: 1) Sep 02 05:09:11.830359 dv-cinder-853910-7-smb devstack@keystone.service[81501]: spawned uWSGI worker 2 (pid: 81515, cores: 1) Sep 02 05:09:11.830359 dv-cinder-853910-7-smb devstack@keystone.service[81501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 05:09:16.074927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:09:16.074927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Sep 02 05:09:16.075771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:09:16.075771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Sep 02 05:09:16.084382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:09:16.084382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Sep 02 05:09:16.084891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 05:09:16.084891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Sep 02 05:09:16.124560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:09:16.124768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:09:16.124930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] command line args: [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:09:16.125189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:09:16.125321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ================================================================================ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:09:16.125597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.125836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_dir = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.125996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.126260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_source = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.126428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] debug = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.126690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.127109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.127329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.127597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.127799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_config_append = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_dir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.128916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.129201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.129416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.129654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.129799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.129987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.130219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.130457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.130685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.130912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.131136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.131386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.131622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.131858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.131950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 05:09:16.132083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 05:09:16.132164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.132263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] command line args: [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 05:09:16.132543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 05:09:16.132635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.132713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ================================================================================ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 05:09:16.132843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] publish_errors = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.132925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_dir = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_source = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] debug = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.133996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] standard_threads = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_journal = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.134915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_json = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_stderr = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_config_append = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_syslog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_dir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.135876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.135963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.136116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.136196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.136356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.136442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.136597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.136687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.136759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.136845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.136929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.137061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.137152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.137288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.137369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.137529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.137618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.137750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.137833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.137995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.138071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.138217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.138364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.138440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.138510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.138673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.138756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.138913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.139001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.139153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.139405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.139482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.139614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] publish_errors = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.139698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.139841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.139924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.140065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.140146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.140226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.140330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.140465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.140577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.140694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.140830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.140915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] standard_threads = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.141075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.141157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.141317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.141394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.141523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.141616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.141747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_journal = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.141892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.142022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_json = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.142153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_stderr = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.142282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.142401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_syslog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.142477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.142547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 05:09:16.142616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.142772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.142855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.143958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.144967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.145850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.146925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.147986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.148899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.149959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.150955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.151917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.152964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.153949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.154859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.155939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.156940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.157903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.158937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.159992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.external = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.160906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.password = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.token = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.161997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.162928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.163880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.164879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.165932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.166951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.external = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.167938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.168859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.password = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.token = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.169932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.170992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.171855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.172808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.173952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.174932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.175998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.176992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.177944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.178937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.179922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.180857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.181979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.182979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.183946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.184860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.185939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.186936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.187872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.188921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.189933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.190873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.191974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.192986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.193910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.194984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.195958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.196953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.197959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.198993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.199966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.200900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.201958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.202986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.203943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.204949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.205937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.206983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.207909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.208988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.209983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:09:16.210609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.210826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.211067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.211332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.211564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.211798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.212029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.212270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.212539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.212766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.213004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.213264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.213521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.213759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.214002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.214235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.214474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.214705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.214936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.215167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.215421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.215665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.215897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.216134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.216367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.216611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.216840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.217078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.217303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.217539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.217768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 05:09:16.217933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 05:09:16.239691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.239909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.240133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.243093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.243674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.243894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.248732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.252597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.276419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.276651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.278206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.278439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.328695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.329523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.376561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.376784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.377716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.377949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.531439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.531732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.531897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.532886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.533100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.533272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.555361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.555568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.555800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.555924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.555992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.556825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.557051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.567956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.568171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.580702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.580852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.581922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.582149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.582316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 05:09:16.598609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.598793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 05:09:16.598987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.599114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.599183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 05:09:16.599371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 05:09:16.599542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.599627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.599726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 05:09:16.599923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.600111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.600235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.600387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.600524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.600741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.601009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.609839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.610862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.611172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.617524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.618085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.620717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.621001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.621291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.621436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.621509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.621585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.621818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.621943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.622985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.623133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.623302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.623395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.623473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.623766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.624032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.645914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.646454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.647376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.647658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.647945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.648219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.652258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.652542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.652789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.652879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.653109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.653394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.659185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.659486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.659743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.660024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.664068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.664325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.664638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.664938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.665220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.665853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.666048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.666176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.666372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.666637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.666881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.682307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.682589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.683068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.683365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.686396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.687329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.689707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.689968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.690468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.690762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.694144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.694953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.697247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.698181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.700431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.700695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.701948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.702128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.702413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.702687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.717389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.717672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.717934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.718196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.718322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.718595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.718873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.719103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.725022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.726538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.728095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.728365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.731025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.731328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.731607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.731896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.732289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.734491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.736631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.738183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.738454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.741224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.741519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.741817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.742110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.742387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.743599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.743884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.744165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.744436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.744785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.745055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.745335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.754730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.755020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.755318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.755595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.755872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.756148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.756426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.760781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.763674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.766507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.768226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.769680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.769970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.770357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.772252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.775121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.777228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.777980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.778673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.779552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.781002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.781294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.781521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.781646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.781911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.782166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.782505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.788921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.790340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.790467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.790624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.790901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.793394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.793680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.793966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.794239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.797717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.798122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.798501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.798775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.799047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.799342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.799625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.799898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.800181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.800449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.800696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.800951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.801216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.801474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.802698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.802986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.803290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.810021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 05:09:16.810316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.810593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.810851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.811127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.811416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.811701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.811953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.812339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.812619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.812890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.813151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.813416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.813834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 05:09:16.835106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557bad5679c0 pid: 81514 (default app) Sep 02 05:09:16.838346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71478daf-0a84-40a7-b2cb-f10629d57d92 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:16.838626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71478daf-0a84-40a7-b2cb-f10629d57d92 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:16.838891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71478daf-0a84-40a7-b2cb-f10629d57d92 None None] PATH_INFO: `/v3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:16.843126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Fri Sep 2 05:09:16 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:16.848689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557bad5679c0 pid: 81515 (default app) Sep 02 05:09:23.408900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:23.409840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:23.409840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:23.412144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:23.420121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:23.420701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:23.420701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:23.497145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: INFO dbcounter [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] Registered counter for database keystone Sep 02 05:09:23.519401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG oslo_db.sqlalchemy.engines [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:09:23.529373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writer thread running {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:09:23.725765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81515) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 05:09:23.726149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81515) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 05:09:23.787167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:23.788807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:23.937948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 02 05:09:24.248248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:24.325277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: INFO dbcounter [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] Registered counter for database keystone Sep 02 05:09:24.349810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG oslo_db.sqlalchemy.engines [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 05:09:24.361401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writer thread running {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 05:09:24.481897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cdf8e-31cf-4577-a28f-9198c25f4180 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:24.487057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:24.487713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:24.487989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:24.488256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:24.496969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:24.548589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 05:09:24.548862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514cadd-93c1-4944-9215-362fe532327c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:24.559078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Sep 2 05:09:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:09:24.569212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:24.587756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760dd4f-7703-42e9-baa1-65a6b121e5e3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:24.594339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:24.595565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:24.595847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:24.596120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] PATH_INFO: `/v3/projects/a9a94747b8f64b12a67048c396b7c9c0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:24.597897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a9a94747b8f64b12a67048c396b7c9c0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:24.650554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 05:09:24.650898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c23180-8452-48fd-82ae-f9b135c48fd4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:24.655559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Sep 2 05:09:24 2022] GET /identity/v3/projects/a9a94747b8f64b12a67048c396b7c9c0 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:26.569130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24976c2a-ed03-4921-9d2d-405aaa4f8f2d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:26.569693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24976c2a-ed03-4921-9d2d-405aaa4f8f2d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:26.569693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24976c2a-ed03-4921-9d2d-405aaa4f8f2d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:26.576692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:09:26.582780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:26.583272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:26.583358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:26.615655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:26.617538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:26.629207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 02 05:09:26.944531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24976c2a-ed03-4921-9d2d-405aaa4f8f2d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:26.957793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24976c2a-ed03-4921-9d2d-405aaa4f8f2d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:26.963167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:26.963797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:26.964068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:26.964334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:26.973338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:26.975135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1d903-8698-48c1-9c36-88d34529f482 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:26.989277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Sep 2 05:09:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:09:26.995565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:27.007491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4382a4-5e8d-4425-96a4-04cd8a838038 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:27.013246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:27.013881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:27.014154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:27.014419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:27.015985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:27.017909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492d9db-5e56-4d26-a5d5-6f62a603d0ee admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:27.019641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Fri Sep 2 05:09:26 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:28.979886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf4c3-4984-459a-a4ab-9b6b8f6da320 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:28.980460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf4c3-4984-459a-a4ab-9b6b8f6da320 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:28.980460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf4c3-4984-459a-a4ab-9b6b8f6da320 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:28.981731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:28.986899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:28.987377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:28.987466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.006047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:29.007241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:29.059924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491727e2-8599-41cd-a8e2-2b6482415b31 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.060328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491727e2-8599-41cd-a8e2-2b6482415b31 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.060633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491727e2-8599-41cd-a8e2-2b6482415b31 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.061993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:29.067535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.067823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.068073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.089050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:29.110426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81514) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 05:09:29.110813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81514) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 05:09:29.159554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:29.161122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:29.263510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:29.351231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.376634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:29.457553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57dc7d-8a9f-4093-bd3d-d4a67e777a02 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.494624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.495263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.495560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.495828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.507578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:29.516381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:29.517328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:29.518163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:29.523328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.524716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.612082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:29.624302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d2459-18a0-4c63-bd78-dc6c2330a30a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.626751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:29.630908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432526-7bea-4a70-999d-9dac7bfcd075 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.662697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.663604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.663881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.664149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.664825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.664978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:29.665272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:29.665441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.665721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.665992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.666735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:29.678835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 9/15] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:29.684815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.735518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:29.736963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:29.781553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f72fd-c9df-4ef1-a577-d606f3502fe6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.818422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.819320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.819597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.819869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.820914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:29.821389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:29.823004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:29.824797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 10/16] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:29.830715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.841488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 7/17] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:29.847551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.868563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:29.934256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e55a-1cc5-443c-b1e3-11d039caa9b7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.945470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138c06-2d1e-497f-9de4-afd3c7e02f13 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:29.968238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.968878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.969156 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.969415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.970662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:29.972162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:29.973752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 11/18] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:29.979532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:29.980527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:29.981159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:29.981433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:29.981697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:29.992628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:29.994417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:09:30.009868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:30.010749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:09:30.011567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:09:30.011567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:09:30.011567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:30.011567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 8/19] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:30.016913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:30.052734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:30.077657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a442f-5732-4282-b953-b2892af46ecb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:30.079442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:30.114771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:30.115428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:30.115699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:30.115966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:30.116694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.domain.id=default, user.id=1444fa15af784a62ae966718f3a66e87) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:30.116994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:30.118755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51937be6-6fc7-49f2-aeab-e92ee1029db1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:30.126500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28459b7-b7a7-4246-8d64-d534f106c218 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:30.127973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 12/20] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Sep 2 05:09:29 2022] GET /identity/v3/role_assignments?user.id=1444fa15af784a62ae966718f3a66e87&scope.domain.id=default&role.id=043be44598c24b52b429eb2a25c1962d => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:30.164476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:30.165096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:30.165366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:30.165629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:30.166280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:30.166574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:30.168023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb9ca3-29e4-481a-b78e-24ec0f8bc3f3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:30.187445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 9/21] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:32.314160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf492-6455-4394-a3a1-b27cec2b185a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.314675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf492-6455-4394-a3a1-b27cec2b185a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.314747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf492-6455-4394-a3a1-b27cec2b185a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.316130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 13/22] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:32.321493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d92eb-f986-42d8-b85f-695fa14d2883 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.322275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d92eb-f986-42d8-b85f-695fa14d2883 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.322761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d92eb-f986-42d8-b85f-695fa14d2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.352638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-804d92eb-f986-42d8-b85f-695fa14d2883 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:32.354442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-804d92eb-f986-42d8-b85f-695fa14d2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:32.445154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 10/23] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:32.492620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af96f-3047-4c3d-af74-fab457b51434 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.493530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af96f-3047-4c3d-af74-fab457b51434 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.494014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af96f-3047-4c3d-af74-fab457b51434 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.495583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 14/24] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:32.500807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad34979-dd84-4cc3-b2f4-5ee1038a79f9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.501345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad34979-dd84-4cc3-b2f4-5ee1038a79f9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.501802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad34979-dd84-4cc3-b2f4-5ee1038a79f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.533742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2ad34979-dd84-4cc3-b2f4-5ee1038a79f9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:32.534959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ad34979-dd84-4cc3-b2f4-5ee1038a79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:32.561226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:32.612994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 11/25] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:32.823290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b47-a978-4b59-b93d-9fdcdc30275a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.823793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b47-a978-4b59-b93d-9fdcdc30275a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.824200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b47-a978-4b59-b93d-9fdcdc30275a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.825678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 15/26] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:32.831172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12c4e5-5fea-4c2a-a54e-a990a17b423a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:32.831591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12c4e5-5fea-4c2a-a54e-a990a17b423a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:32.831965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12c4e5-5fea-4c2a-a54e-a990a17b423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:32.861688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1b47-a978-4b59-b93d-9fdcdc30275a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:32.862121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3e12c4e5-5fea-4c2a-a54e-a990a17b423a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:32.871269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3e12c4e5-5fea-4c2a-a54e-a990a17b423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:33.007028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 12/27] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:33.008336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff251-d5ba-456e-9800-710ba60def11 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.008619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff251-d5ba-456e-9800-710ba60def11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.008888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff251-d5ba-456e-9800-710ba60def11 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.010111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 13/28] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:33.010781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff251-d5ba-456e-9800-710ba60def11 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:33.030075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1b47-a978-4b59-b93d-9fdcdc30275a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:33.097766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:33.098400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.098674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.098941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.123821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4dd63d47-c87b-440c-8e6d-8f6078d2779b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:33.140432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:33.141295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 16/29] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:09:33.143026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.143762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.143762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.180826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:33.184363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:33.191540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:33.214484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff251-d5ba-456e-9800-710ba60def11 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:33.230306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:33.296474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 17/30] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:33.297839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:33.298699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:33.303240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.303240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.303240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.303240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:33.303240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:33.498510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac22ebd-6e33-4022-9501-ad5f8c30e27c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:33.535693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 14/31] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Sep 2 05:09:33 2022] POST /identity/v3/roles => generated 219 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:33.537599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:33.616665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:33.617254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.617535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.617803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.618799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:33.619097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:33.620530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:33.632164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 18/32] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:33.633037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:33.664249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f3c2d-87f2-416e-8a1b-504f3702c096 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:33.676923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:33.708180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:33.709186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.709318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.709564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.721831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:33.723557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:33.726977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:09:33.752008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:33.752930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:09:33.753981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:09:33.753981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:09:33.753981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:33.753981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 15/33] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:33.754557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:33.764643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb153dc-6534-42f3-8829-7f47bf8893c5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:33.809197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:33.809820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:33.810117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:33.810351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:33.811018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:33.812429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:33.948430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 19/34] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Sep 2 05:09:33 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:33.949470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.020778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62224-ba73-4539-a8b5-1738fd2e32e0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.043685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.061261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.061930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.062188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.062460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.063933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.065545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3bec-d5cd-4827-bc63-40bb2cf39cb5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.071872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 16/35] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:33 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:34.071872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c766e-4826-4918-812d-feb8cc2aeffc None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.071872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c766e-4826-4918-812d-feb8cc2aeffc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.071872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c766e-4826-4918-812d-feb8cc2aeffc None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.071872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 17/36] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:34.072290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f6ce-4ae5-455e-98e0-3a541ea916be None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.072523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f6ce-4ae5-455e-98e0-3a541ea916be None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.072779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f6ce-4ae5-455e-98e0-3a541ea916be None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.078310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 18/37] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:34.078310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f6ce-4ae5-455e-98e0-3a541ea916be None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.082068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7d60-2deb-4eff-90c5-422aa9fc4058 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.128240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.128870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.129143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.129412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.130071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:34.130369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.131920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06016cbe-53d2-48ff-b8c9-f72d3c0cef9c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.155191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:34.156732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.157171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.157459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.159507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.177187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:34.178741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:34.199835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f6ce-4ae5-455e-98e0-3a541ea916be None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.233270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.233913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.234196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.234470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.235913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.237397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16e0e7-5f4f-4133-9359-b302bfdf915d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.238984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 19/39] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:34.240124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.240405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.240681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.252600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 21/40] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:34.253765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.265464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:34.267561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:34.320636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.338921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:34.339865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.372662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef2dd9-43ba-4bdc-bd9c-f113b8352bbe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.409432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.410421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.410900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.411384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.412240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.414055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.419655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.459737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:09:34 2022] POST /identity/v3/projects => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:34.474534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbd30c-81cb-4196-a1ac-5a596a139566 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.516245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.516967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.517421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.517731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.518012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] PATH_INFO: `/v3/domains/default/users/1444fa15af784a62ae966718f3a66e87/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.520124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1444fa15af784a62ae966718f3a66e87, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.521634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.541337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1361 bytes} [Fri Sep 2 05:09:34 2022] PUT /identity/v3/domains/default/users/1444fa15af784a62ae966718f3a66e87/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:34.640345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.655644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362162e9-38f0-4e63-85e0-3785c5389c22 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.679268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.705121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.705795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.706083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.706356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.708306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.709060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.710680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 23/44] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:34.717856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:34.776864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4648-2151-4929-a5d2-c9e97aba63f3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.800368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:34.814126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.814745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.815029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.815755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.816792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.818432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68733f0-ca62-4d54-8872-5298c748c604 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.827239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2323e-e3ad-44c9-82a3-d6eca602227a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:34.836934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Sep 2 05:09:34 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:09:34.869571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:34.870540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:34.871058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:34.871529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:34.872463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:34.874291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cf2f4-5c9c-4f26-b8be-250db9626ba7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:34.907453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:09:34 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:09:36.444897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5217ee-4704-4f91-ba4e-79bca293a311 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:36.445438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5217ee-4704-4f91-ba4e-79bca293a311 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:36.445438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5217ee-4704-4f91-ba4e-79bca293a311 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:36.446785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:36.452043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:36.452449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:36.452662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:36.472718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:36.473901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:36.510536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:36.545367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:36.804432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e670a-35cd-43ad-83db-3b63d0eaaf01 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:36.804679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e670a-35cd-43ad-83db-3b63d0eaaf01 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:36.804967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e670a-35cd-43ad-83db-3b63d0eaaf01 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:36.806856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 24/49] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:36.806982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:36.811809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:36.812096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:36.812373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:36.831164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:36.832382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:36.900816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 25/50] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:36.909761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b28d1-692a-490b-be0b-f426a6fa7c82 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:36.942906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:36.943574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:36.943854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:36.944128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:36.954912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:36.959858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:36.960842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:36.961703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:36.969040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.073459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70055e8-ada6-40ff-924a-3bcb6182e89f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.087114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:37.110439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.111324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.111594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.111871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.112543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:37.112850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.114247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.126739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 26/52] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:37.132653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.164709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:37.167332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.236036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f894-adba-4042-9861-64367f7aacba None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.269943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.270581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.270864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.271141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.272189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f62e38-b11d-40ad-b876-938fa58b062a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.272287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.273752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.275366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:37 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:37.280904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.309073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.309726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.310001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.310260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.311412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.312882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.314617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:37.320106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.364341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:37.381411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:37.385338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0347e4-4a16-41ee-8498-3506c3195da4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.421363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.422011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.422297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.422643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.424677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.426158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.428607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:37.430223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7743b7-0505-44ff-8ead-b5d099a138ba None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.434453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:37.479862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.480495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.480779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.481051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.482056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.483895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9455437-7edf-4253-a17e-96ae1de7ccee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.522041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 28/56] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Sep 2 05:09:37 2022] POST /identity/v3/projects => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:09:37.551327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fbcc-ffbc-47fd-b901-54ec61a9ec2d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:37.590450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:37.591227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:37.591573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:37.591852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:37.592603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.domain.id=default, user.id=1444fa15af784a62ae966718f3a66e87) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:37.592913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:37.594449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4b0c-4232-4d68-85f0-2e40124e5044 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:37.601508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Sep 2 05:09:37 2022] GET /identity/v3/role_assignments?user.id=1444fa15af784a62ae966718f3a66e87&scope.domain.id=default&role.id=043be44598c24b52b429eb2a25c1962d => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:39.438043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c96a-852d-4ed1-9ac3-bb9ebf61830f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:39.438624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c96a-852d-4ed1-9ac3-bb9ebf61830f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:39.438624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c96a-852d-4ed1-9ac3-bb9ebf61830f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:39.440053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:39.445447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:39.445861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:39.445966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:39.571010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:39.572250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:39.600312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:39.655802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:39.922031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c96a-852d-4ed1-9ac3-bb9ebf61830f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:40.031066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:40.044349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c96a-852d-4ed1-9ac3-bb9ebf61830f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:40.080882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:40.081515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:40.081804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:40.082075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:40.083277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:40.084744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745ee50-d678-47f1-be9f-3dd265cdd0d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:40.086309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:40.092145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:40.216151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7ac9-8706-4c0a-bc6f-b90b8c53fb62 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:40.252321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:40.252927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:40.253206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:40.253471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:40.254116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:40.255590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087f121-28ac-4fe2-a91c-803fee48e444 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:40.285798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:09:40 2022] POST /identity/v3/users => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:43.070784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0f53-b389-4695-86e8-03722f1bceea None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.071346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0f53-b389-4695-86e8-03722f1bceea None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.071346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0f53-b389-4695-86e8-03722f1bceea None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.072748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:43.078056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626cbc-5e2f-4fe2-b3a8-256df6e2df59 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.079072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626cbc-5e2f-4fe2-b3a8-256df6e2df59 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.079662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626cbc-5e2f-4fe2-b3a8-256df6e2df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.103858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-de626cbc-5e2f-4fe2-b3a8-256df6e2df59 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:43.105365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-de626cbc-5e2f-4fe2-b3a8-256df6e2df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:43.117233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:43.178920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 32/63] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:43.397360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5986-6bd9-4b14-994c-d8f52d80b559 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.398023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5986-6bd9-4b14-994c-d8f52d80b559 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.398494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5986-6bd9-4b14-994c-d8f52d80b559 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.400083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 32/64] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:43.405519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.406061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.406525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.428761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:43.429937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:43.464598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370909-4f92-4416-b0c6-829cc90b8ba8 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.465656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370909-4f92-4416-b0c6-829cc90b8ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.466297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370909-4f92-4416-b0c6-829cc90b8ba8 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.468126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 33/65] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:43.473867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.474416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.474879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.494660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:43.496286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:43.528816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:43.588269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:43.596644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:43.723581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:43.739747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dc2bb-92cd-4472-91b2-3f7f2fb0f863 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:43.790697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:43.791383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:43.791664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:43.791933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:43.812307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:43.817266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:43.818057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:43.818817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 34/68] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:43.824321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:43.857765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:43.976831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:43.985139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580bab-19f3-4a68-a1a8-59b66c8974ad None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:43.988848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdff23-803d-4bf8-9759-2abb62f9a1b8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.023074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.023398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.023721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.023999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.024112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.024262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.024359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.024578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.025063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:44.025321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.026716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.027599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.035631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.035631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.041526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-64df1c10-9aba-4662-85a0-43311d7eab11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:44.046685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:44.047884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:44.048675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 35/70] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:09:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:09:44.049283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee701d3-373d-43be-ad80-e748260111b7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.049958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee701d3-373d-43be-ad80-e748260111b7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.049958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee701d3-373d-43be-ad80-e748260111b7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.051714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 36/71] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:44.055354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee701d3-373d-43be-ad80-e748260111b7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.153034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f37ae-bf56-4af3-95c5-dd0942d7fe5c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.171611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee701d3-373d-43be-ad80-e748260111b7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.190989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.191653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.191927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.192193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.202919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:44.207605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.208242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.208519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.208788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:44.209369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:44.210174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:44.210948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 36/72] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:44.211608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.230508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.234602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.236215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5776ae4-b91d-46d9-98ee-a3810e280336 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.238105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.244009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.244295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.244574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.264491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:44.266017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:44.315457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.324336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01def6-6015-445e-9767-3269ccea107f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.333270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 38/74] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:44.336385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.360118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.360659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.360936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.361208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.361876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:44.362173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.363603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.372227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.377552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.445718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75117b-06ca-423a-8cce-4a221de219dd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.452130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.484353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6376b-1bdb-452a-9331-e4f6ec4b0c35 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.487087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.487753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.488034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.488305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.489057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:44.489289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.490678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47737c22-b161-4595-a91f-f7fb34a9a05f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.503840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.503840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cfb5-97d5-45d6-baed-ac50819c2409 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.503840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cfb5-97d5-45d6-baed-ac50819c2409 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.503840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cfb5-97d5-45d6-baed-ac50819c2409 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.503840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 40/77] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:44.507321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cfb5-97d5-45d6-baed-ac50819c2409 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.524627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.525278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.525648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.525825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.555931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.599104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.600612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c6048-402f-4683-b5d2-d26fe58b3cd6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.610768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cfb5-97d5-45d6-baed-ac50819c2409 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.644390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.645027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.645309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.645581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.646701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.648188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.649779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 41/78] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.654664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.680917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.705274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 38/79] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:44.706508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.706792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.707061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.724080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:44.725277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:44.756896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92585-9260-4a13-b8c0-78a840e102ba None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.769885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.790225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.790831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.791112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.791412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.792412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 39/80] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:44.792547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:44.793253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.793994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:44.795744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 42/81] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:44.796341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:44.901332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77b326-5ddb-45e7-9124-8596ed1fb52d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.902347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e463e4c-dc22-4b33-b8f1-5f8072eec0e1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:44.911059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:44.938653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.939099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.939409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.939686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.946802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:44.947801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:44.948299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:44.948768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:44.950111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:44.955011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:44.955915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:44.956635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 40/82] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:44.957241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.009942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.030068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.031694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.069931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b32a4-4bf4-4434-a9eb-5b4c57143bfa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.103151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.103819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.104104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.104374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.105498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.106958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.108614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 41/83] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.109370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.133545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:45.134584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.142321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.209490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a90f-cf5b-49fe-97bb-892425690565 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.215515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.236986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9497c-1011-44dd-b58c-6f73268abd66 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.253013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.253633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.253912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.254183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.271934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.272482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.272760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.273031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.273698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:45.274002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.275409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.284202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 44/85] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.285000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.322631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.324153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.357359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.388915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2f07-9860-49ec-a7dd-f9e4b6794663 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.424531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.425170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.425487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.425721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.426126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 42/86] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:45.426960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.431735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.433219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.434828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 45/87] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.435631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.451811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.532387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc89a1a-7bf8-4752-bb7b-c58292f4a768 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.541674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ccdb-0b2e-4eed-be9f-f7b33f24367a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.567845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.568469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.568745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.569023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.569756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:45.570063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.571553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.573419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.576808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.577454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.577736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.578011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.579291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.579885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 43/88] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.580690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.580802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.587222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 46/89] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.587222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.680522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.702736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a8fc8-cf0e-4440-ba49-afac55bcd818 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.703067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1f1d2-60f3-4bdb-8803-701db7969b6c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.740399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.741049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.741321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.741595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.742715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.744534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.746141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 44/90] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.748362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.749009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.749288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.749560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.750877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.751560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.752309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.758716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 47/91] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.758716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.818149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.868582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aca21-188f-4e1e-abaf-1ba3c3e83105 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.877835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc369c2-594f-44b5-934e-5e7830fc0c40 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:45.907234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.907874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.908136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.908419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.909068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.910821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.912190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:45.912807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:45.913092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:45.913435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:45.914150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:45.914461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:45.915949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:45.921738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:45.922637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:45.948401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:45.955107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 45/93] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:09:45 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:45.960316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:46.098411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e597a-fa04-4c50-92b4-a979934e812f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:46.152024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:46.153242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:46.153695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:46.154137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:46.155178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96041-61b6-46a4-9eb9-fcfff1d294e0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:46.186139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:46.204991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:46.205701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:46.206044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:46.206382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:46.207466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=1444fa15af784a62ae966718f3a66e87) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:46.207840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:46.210320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:46.217089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 46/94] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/role_assignments?user.id=1444fa15af784a62ae966718f3a66e87&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:46.256950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:46.259075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:46.276844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:46.385313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 49/95] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:46.390919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:46.510009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dffd1b-e36d-4e2b-81d9-c90800f26079 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:46.548412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:46.551123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:46.551601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:46.552045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] PATH_INFO: `/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:46.553499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=548b1cf608744aa5b6fa0bf5b97cf94a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:46.555238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372d4a4-ba7e-41fb-b611-899562d2e5b3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:46.557131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 47/96] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:46 2022] GET /identity/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:46.563114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:46.667267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3996c-d3ce-4c25-b9a8-433084b005db None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:46.682000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:46.704687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:46.705702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:46.705980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:46.706246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:46.706980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=548b1cf608744aa5b6fa0bf5b97cf94a, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:46.707314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:46.708892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2317f-3ddd-4621-9cc4-20a3873e60d1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:46.715052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 50/97] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:46 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=548b1cf608744aa5b6fa0bf5b97cf94a&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:47.806796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6bca-b6a4-4f6d-bd15-a12f1c41b3a4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:47.807331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6bca-b6a4-4f6d-bd15-a12f1c41b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:47.807645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6bca-b6a4-4f6d-bd15-a12f1c41b3a4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:47.809317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 48/98] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:47.820618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad913-1e13-4582-9e31-dde378880769 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:47.821042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad913-1e13-4582-9e31-dde378880769 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:47.821221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad913-1e13-4582-9e31-dde378880769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:47.840569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-06aad913-1e13-4582-9e31-dde378880769 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:47.841754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06aad913-1e13-4582-9e31-dde378880769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:47.933492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:48.236201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9be2-6eab-46f2-8f66-adf5cc66669f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:48.236569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9be2-6eab-46f2-8f66-adf5cc66669f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:48.236760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9be2-6eab-46f2-8f66-adf5cc66669f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:48.238354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 49/100] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:48.243835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:48.244125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:48.244399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:48.273044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:48.273727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:48.371076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 52/101] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:48.531488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a9be2-6eab-46f2-8f66-adf5cc66669f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:48.607656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:48.664875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a9be2-6eab-46f2-8f66-adf5cc66669f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:48.707945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:48.708592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:48.708868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:48.709138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:48.724436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:48.729365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:48.730250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:48.730974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 50/102] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:48.744725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:48.792610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:48.866946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd75398-f8e4-4320-a359-8829877ad97a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:48.906192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:48.907483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:48.907962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:48.908467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:48.909332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:48.909820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:48.911419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:48.922804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 53/103] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:48.929155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:48.982504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.042813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4bd0-e9a8-4e0b-839f-9b74bb027a07 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.057942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.083224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.083224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.083224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.083224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.083623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.083897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.085555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 51/104] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:48 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:49.093003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.165299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.175433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92139f54-d6e3-4b90-9bc4-5b95c5412d82 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.222981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.223658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.223939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.224213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.246786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-197ac271-4a98-452d-9d68-e0a12bdd807d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:49.254375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:49.255249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:49.255978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 54/105] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:09:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:49.257327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0136-bdae-494e-bc80-c592d1d3a43d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.257327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0136-bdae-494e-bc80-c592d1d3a43d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.257327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0136-bdae-494e-bc80-c592d1d3a43d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.259888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 55/106] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:49.263639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f0136-bdae-494e-bc80-c592d1d3a43d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.295105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512e87-2cdd-42be-bcb7-02074ca5fbc9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.341339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.342376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.342846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.343360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.344896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.346579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5bf7-3f4d-4e47-aa88-e865eeca4279 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.348579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 52/107] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:49 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:49.350302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.350808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.351445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.371670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:49.373179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:49.390294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f0136-bdae-494e-bc80-c592d1d3a43d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.423664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.432006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.432631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.432908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.433178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.433839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:49.434138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.436110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309484d5-4398-491a-ac6a-a4ca9619c450 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.447038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 56/108] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:09:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:49.448686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6e72-5c05-4755-8907-8897ea39fb1d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.448968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6e72-5c05-4755-8907-8897ea39fb1d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.449238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6e72-5c05-4755-8907-8897ea39fb1d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.450315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 53/109] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:49.451271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 57/110] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:49.451486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6e72-5c05-4755-8907-8897ea39fb1d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.456433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.485643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.581682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6e72-5c05-4755-8907-8897ea39fb1d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.591803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a50f7-9394-42ed-b157-d32009042efe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.623288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.623966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.624248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.624528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.626864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, user_id=7a13bfb8ac1e4509aab08b1d7a9cf762, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.627780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.628431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.628519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e9197-3118-439f-ba57-1d3e6633e6bd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.628713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.628985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.630224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.631717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7612fb1-4581-46df-b92f-88756c1ee186 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.633488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 54/111] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:49 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:49.634589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242001-0767-4986-84cc-d61ca501e852 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.634878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242001-0767-4986-84cc-d61ca501e852 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.635155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242001-0767-4986-84cc-d61ca501e852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.649199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 58/112] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:09:49 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:49.652707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c82e1e-8a10-46da-9d5c-412d323ff6d9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.653301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c82e1e-8a10-46da-9d5c-412d323ff6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.653811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c82e1e-8a10-46da-9d5c-412d323ff6d9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.653910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a3242001-0767-4986-84cc-d61ca501e852 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:49.655108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a3242001-0767-4986-84cc-d61ca501e852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:49.655960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 59/113] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:49.657598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6daa-2b10-448f-90a1-90ddc2a4824f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.658399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6daa-2b10-448f-90a1-90ddc2a4824f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.658865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6daa-2b10-448f-90a1-90ddc2a4824f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.660742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 60/114] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:49.661809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f6daa-2b10-448f-90a1-90ddc2a4824f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.714104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.742745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:49.744669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1cef5-9fd3-4f8a-9880-2c0a0a90c5ee None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.745314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1cef5-9fd3-4f8a-9880-2c0a0a90c5ee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.745314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1cef5-9fd3-4f8a-9880-2c0a0a90c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.765175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b4d1cef5-9fd3-4f8a-9880-2c0a0a90c5ee None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:49.767013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b4d1cef5-9fd3-4f8a-9880-2c0a0a90c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:49.780166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:49.810944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f6daa-2b10-448f-90a1-90ddc2a4824f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:49.846448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 56/116] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:49.847890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.848267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.848605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.852736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:49.853596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:49.854041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:49.854475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:49.855826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:49.857431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:49.859288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 61/117] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:49 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:49.860369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:49.868831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:49.870307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:49.985280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 57/118] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:49.988452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.009149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22b515-e7e3-4bea-b65b-6879eea6f741 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.063408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.079663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.080407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.080754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.081088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.100984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:50.108858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:50.110014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:50.110946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:50.111638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:50.114639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.138864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.185164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8b06-ed27-4d74-801e-b3912767e9ab None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.227934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.228841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.229282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.229692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.231987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, user_id=7a13bfb8ac1e4509aab08b1d7a9cf762, role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.233611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.253991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 58/120] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:09:49 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:50.255520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.264026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97d4d-061e-478d-972a-eac1227830b8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.310600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.311369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.311749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.312120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.324588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:50.330190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:50.331178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:50.332124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:50.333784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 63/121] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:50.334674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.400054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.404080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645322-e2a0-49ff-8630-f58e0853be2e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.416322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.457403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4ccb4-c8f8-4526-9f16-1aace068ae18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.473998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.475037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.475438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.475779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.476481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:50.476788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.478296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.491289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 59/122] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:50.492477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.503997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.504985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.505475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.505847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.519640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:50.524680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:50.525711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:09:50.526653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:50.528577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 64/123] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:50.529615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.625130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99da1-bd11-4978-b6d6-f733f541ea3d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.653447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204ca6-b5ca-42f9-b979-6391d6a7b5e9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.663450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.664072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.664452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.664820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.665590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:50.666204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.667726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.677366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 60/124] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:50.678420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.687090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.698542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.699429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.699871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.700261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.702155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.704115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.706479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 65/125] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:50.707424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.712987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.817767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde3f4-a379-4708-b288-2f1f9cd7c090 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.838582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee6324-e853-48bc-adc9-1a97d7cd94f4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:50.865731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.866433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.867276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.867567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.869259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.871574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.874105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 61/126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:50.875060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.889722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:50.890443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:50.890792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:50.891226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:50.892585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:50.892962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:50.894562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:50.909947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 66/127] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:50.911033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:50.972698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.984140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:50.984978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a2db-523d-4c44-8c12-5e3b330738d9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.024388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.025267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.025798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.026318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.027829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.029378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.031057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 62/128] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:50 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:51.032036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.041767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16deec-a006-4951-90b6-f6575898fe64 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.088788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.089928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.090345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.090787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.092182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.094013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.126638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 67/129] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:09:50 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:51.127923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.144875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca354-a37a-4ed3-8817-09a7bb294d4b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.188773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.188963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.189810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.189810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.190798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.192571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.197474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 63/130] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:51 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:51.198338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.262313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:51.300634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8d753-513d-48b3-bdcf-a937751820d1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.318961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:51.347889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.348580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.348862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.349172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] PATH_INFO: `/v3/users/64ba663188004f73b4eac9a946902f80` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.366433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] RBAC: Authorizing `identity:get_user(user_id=64ba663188004f73b4eac9a946902f80)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.368018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.370635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 68/131] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:51 2022] GET /identity/v3/users/64ba663188004f73b4eac9a946902f80 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:51.371429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.386665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db631c-1724-4643-a0f1-fd4d26577731 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.453626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.454213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.454584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.454863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] PATH_INFO: `/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.469628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] RBAC: Authorizing `identity:get_project(project_id=548b1cf608744aa5b6fa0bf5b97cf94a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.471151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.480983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 64/132] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:51 2022] GET /identity/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:51.481803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.496456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf7af-d8bd-431e-80eb-c9dd94afb4da None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.532931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.533901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.534370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.534654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/users/1444fa15af784a62ae966718f3a66e87/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.537057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, user_id=1444fa15af784a62ae966718f3a66e87, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.538962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.556882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 69/133] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:09:51 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/users/1444fa15af784a62ae966718f3a66e87/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:51.557857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:51.607580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:51.678220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb05b-d2f4-4afe-bd90-f9b800d4cf5b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.689913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:51.692190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d95dae-5c4a-4e4f-a383-9dd552ca0290 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:51.725338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.726024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.726307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.726590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] PATH_INFO: `/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.728715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] RBAC: Authorizing `identity:create_grant(project_id=548b1cf608744aa5b6fa0bf5b97cf94a, user_id=7a13bfb8ac1e4509aab08b1d7a9cf762, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.730256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8d8e-31e3-4a77-ac3e-bcccc1e2004e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.755773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:09:51 2022] PUT /identity/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a/users/7a13bfb8ac1e4509aab08b1d7a9cf762/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:51.775597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:51.776232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.776512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.776785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.810415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c323d3-aa25-494a-a48b-deef7fd3945a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.810702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c323d3-aa25-494a-a48b-deef7fd3945a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.810983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c323d3-aa25-494a-a48b-deef7fd3945a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.815338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 71/135] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:09:51.819579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:51.819861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:51.820138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:51.843570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:51.844889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:51.887233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:51.888866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:51.951132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 72/136] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:52.042141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:52.052051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 65/137] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:52.057935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:52.089873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:52.189149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef2c6e-155d-434f-9e6e-89afbf401120 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:52.237648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:52.238296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.238576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.238848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.244245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:52.245660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:52.247708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 73/138] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:52 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:52.253280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:52.348497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:52.441533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231c68-bef2-462c-aa97-eb60613d2ef9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:52.524082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:52.538545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:52.539679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.540418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.540881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.542078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=64ba663188004f73b4eac9a946902f80) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:52.542577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:52.544253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c28116-b326-4d09-bf19-d52930e8a09d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:52.558457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 66/139] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:52 2022] GET /identity/v3/role_assignments?user.id=64ba663188004f73b4eac9a946902f80&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=8411a91add674e5e8dc01f766f6761ef => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:52.561196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92766-6cae-4bff-81a7-c8c6b7399bcf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:52.622250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bf54-d860-4e05-aa15-0386b50c8927 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.622990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bf54-d860-4e05-aa15-0386b50c8927 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.623647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bf54-d860-4e05-aa15-0386b50c8927 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.625267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 67/140] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:52.627921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:52.628584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.628856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.629119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.632775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.633279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.633759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.649774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:52.654946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:52.655823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:52.656607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 74/141] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:09:52.658276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:52.659779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:52.661813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:52.783580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:52.799598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 68/142] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:52.851827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ceab8-1df3-43c6-82e9-729f9f1fc3ad None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:52.895835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:52.896372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:52.896650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:52.896914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:52.897573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:52.897872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:52.899274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:52.912186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 75/143] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:52.917748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.042539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192443b-ce49-44e2-9ae7-4cb6f8a09cb2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.087743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.088388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.088662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.088927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.090038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:53.091505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:53.093291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 69/144] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:52 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:53.098981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.111110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:53.204405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17ce-b48a-436c-b934-f5e06b41c581 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.238495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.239169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.239469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.239742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.309259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:53.310797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:53.323708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:53.376670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.417813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 76/145] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:53.423937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.439463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:53.483692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178e53-e8da-480e-87a3-dfd70391ec5e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.555267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.556166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.556541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.556909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.588030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fc9c-4d54-4695-8d70-ffa0e0cde432 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.590504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:53.595479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:53.596308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:53.597044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 70/146] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:09:53.605514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.615586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:53.667681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.668324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.668600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.668867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.671101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:53.672671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:53.674337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 77/147] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:53.684928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.841364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fcdeb-d867-4576-8199-7c05975336a5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.872680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c0fd-fc50-449d-833c-c23094d6a346 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:53.900917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:53.944141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.944990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.945368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.945824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.946748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:53.947157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:53.948820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98d6fe-ad8f-4966-9719-c9c3f0650e63 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:53.954433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:53.955394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.955869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.956327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.957190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:53.957674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:53.957790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 78/148] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:53.959668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:53.961244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569681f2-bddb-4fc1-885e-b9057aff794d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.967260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569681f2-bddb-4fc1-885e-b9057aff794d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.967260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569681f2-bddb-4fc1-885e-b9057aff794d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.967260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 79/149] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:09:53.969785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:53.970145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:53.970477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:53.978483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 71/150] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:53.984175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:53.994945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:53.997132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:54.087608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:54.133716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 80/151] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:54.148160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0461d-d33e-4c5a-bae0-9d537cf47ff2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:54.199578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:54.200225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.200495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.200763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.201883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:54.203420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195720-685a-407b-93d0-f0a9a01434e2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:54.205025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 72/152] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:53 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:54.210871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:54.345260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf123-0a7f-4d31-b4cf-84745e6351c9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.345570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf123-0a7f-4d31-b4cf-84745e6351c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.345802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf123-0a7f-4d31-b4cf-84745e6351c9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.347156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 73/153] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:54.352429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.352711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.352979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.362588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56b13-d53d-45cd-890a-2c2173e06e33 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:54.379550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:54.380747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:54.401899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:54.402577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.402854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.403117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:54.483600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:54.500433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:54.501403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:54.529711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:54.626527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 81/155] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:54.632123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:54.646666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:54.749696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ebfb-74f7-42f7-af1e-a1edf2277537 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:54.758114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:54.791246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:54.792396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.792814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.793236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.794242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dfa25-5847-4c48-9390-adf5a51082ab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:54.794628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:54.796429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5932e8-9058-49e5-84a5-e68140386af1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:54.799377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 75/156] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:54 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:54.805290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9d0a-3631-48b9-8242-3b45f4c6ee9b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.805290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9d0a-3631-48b9-8242-3b45f4c6ee9b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.805290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9d0a-3631-48b9-8242-3b45f4c6ee9b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.805535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 76/157] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:54.810138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9d0a-3631-48b9-8242-3b45f4c6ee9b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:54.834800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:54.835840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.836594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.837062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.838414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:54.840295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df82b-03d5-448d-9fe8-dcc0bd9a7dbf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:54.842377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 82/158] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:54.843976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.844522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.845002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.860150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:54.865597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:54.867073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:54.918337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9d0a-3631-48b9-8242-3b45f4c6ee9b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:54.936306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 83/159] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:54.937130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:54.967977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:54.968972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:54.969743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:54.970211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:54.971950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:54.972258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:54.973790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:54.987695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 77/160] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:54 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:54.988893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.048874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac81b12-e129-4556-94cb-fd839dde69e5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.053100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.091040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.092327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.093414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.093894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.094815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:55.096520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:55.132729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 84/161] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:09:54 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:55.211060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cc66-6cde-4b62-984f-4089f28d5405 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.218359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.221692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.256243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.256895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.257167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.257430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.272547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:55.278092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:55.279121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:55.279949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 78/162] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:55.285833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.386057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944d90-8371-429d-a235-6eb9f15520c3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.412990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca3928-2c09-4b54-af2c-ba6a0ac9303b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.414175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.430138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.430799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.431074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.431366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.444243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:55.450080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:55.451038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:55.451817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 85/163] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:55.457601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.469203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.470037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.470322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.470600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.471342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:55.471650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:55.473082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189d9f-3d0c-46e3-8559-d3912605a4f7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:55.482303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 79/164] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:55.483564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f08ae-6bf0-4799-a599-2111dfd3e630 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.483849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f08ae-6bf0-4799-a599-2111dfd3e630 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.484123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f08ae-6bf0-4799-a599-2111dfd3e630 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.485699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 80/165] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:55.487768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f08ae-6bf0-4799-a599-2111dfd3e630 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.519431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.588464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0988-5c70-4513-a179-d2b837339042 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.613702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f08ae-6bf0-4799-a599-2111dfd3e630 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.634891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.635644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.635918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.636229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.636852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:55.637147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:55.638530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70882-fd85-4122-be82-fe41d852798d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:55.647230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 86/166] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:55.648354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.648634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.648904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.659972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.660667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.660936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.661198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] PATH_INFO: `/v3/users/1444fa15af784a62ae966718f3a66e87` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.662504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] RBAC: Authorizing `identity:get_user(user_id=1444fa15af784a62ae966718f3a66e87)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:55.664034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:55.665791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 81/167] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/users/1444fa15af784a62ae966718f3a66e87 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:55.666550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.668655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:55.669839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:55.722731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.757968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 87/168] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:55.758821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.790425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:55.797827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205150b-10c6-4660-9b3a-c215a15b6cfa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:55.879913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:55.881292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:55.882604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:55.883292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] PATH_INFO: `/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:55.885628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] RBAC: Authorizing `identity:get_user(user_id=7a13bfb8ac1e4509aab08b1d7a9cf762)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:55.889227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:55.893335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 82/169] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/users/7a13bfb8ac1e4509aab08b1d7a9cf762 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:55.899849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:55.990853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662aaed-457d-4519-b40d-f9a9bc784cf0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.037549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06b71e-c150-4f78-a39d-717d3c9c1d68 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.069347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.069972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.070251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.070522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.105225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.106671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.107422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.108132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.122959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.148366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:56.149740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:56.210020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.273421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:56.277252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:56.302197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 88/170] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:56.302956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:56.456222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 83/171] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:09:56.457482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:56.521891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.546815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1e1f-0c28-45a9-8149-8bfd4494c01a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.567584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.599014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff073eb-8279-451f-9681-24b47877377c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.622951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.624109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.624622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.625176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.635066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.635741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.636196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.636466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.637589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:56.639052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:56.640718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 84/172] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:56.641710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:56.652091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:56.657506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:56.658339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:09:56.659105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:56.661407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 89/173] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:56.662415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:56.832782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab623-46be-4ba5-bb07-9bbf08d0cd28 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.874215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.874860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.875133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.875474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] PATH_INFO: `/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.879628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] RBAC: Authorizing `identity:get_project(project_id=548b1cf608744aa5b6fa0bf5b97cf94a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:56.881126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:56.885599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd895-a29f-4f7c-9773-6a930d83ebbc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:56.887459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 85/174] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/projects/548b1cf608744aa5b6fa0bf5b97cf94a => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:56.888266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:56.897706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.951551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:56.952165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:56.952446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:56.952714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:56.953484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=1444fa15af784a62ae966718f3a66e87) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:56.953796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:56.955421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:56.967497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:56.971379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 90/175] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/role_assignments?user.id=1444fa15af784a62ae966718f3a66e87&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:56.974055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:57.074332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ce9ea-9386-4753-bd17-cea36293fef6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:57.119810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:57.120361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.120638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.120908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.121588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:57.121890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:57.123330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:57.146681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 86/176] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:57.151395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:57.211219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7605d-dbfc-4e2d-9bb2-e21ccadbf585 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:57.236076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:57.284996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5d9f-4cbb-47e7-a761-df2122c8056c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:57.293681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:57.294376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.294750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.295117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.295973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=548b1cf608744aa5b6fa0bf5b97cf94a, user.id=7a13bfb8ac1e4509aab08b1d7a9cf762) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:57.296452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:57.298220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:57.304378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 91/177] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:56 2022] GET /identity/v3/role_assignments?user.id=7a13bfb8ac1e4509aab08b1d7a9cf762&scope.project.id=548b1cf608744aa5b6fa0bf5b97cf94a&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:57.331253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:57.332180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.332601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.333039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] PATH_INFO: `/v3/users/64ba663188004f73b4eac9a946902f80` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.334448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] RBAC: Authorizing `identity:get_user(user_id=64ba663188004f73b4eac9a946902f80)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:57.340323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:57.342330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 87/178] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:57 2022] GET /identity/v3/users/64ba663188004f73b4eac9a946902f80 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:57.348325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:57.473836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:57.526764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10536-2a2f-4cc8-b1da-9eced68089db None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:57.567255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:57.568284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.568787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.569249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.570657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:57.572355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5c82-baf3-4c4f-a871-ca53424a0c62 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:57.574185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 92/179] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:57 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:57.580228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:57.718090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531622-13b3-432f-9cfd-6ddd9d50473c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:57.752083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:57.761043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:57.761725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.762007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.762280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/users/64ba663188004f73b4eac9a946902f80/roles/8411a91add674e5e8dc01f766f6761ef` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.764254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, user_id=64ba663188004f73b4eac9a946902f80, role_id=8411a91add674e5e8dc01f766f6761ef)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:57.765724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6af5ef-21dc-48f4-a908-7d3cc43823d2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:57.785192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 88/180] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:09:57 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/users/64ba663188004f73b4eac9a946902f80/roles/8411a91add674e5e8dc01f766f6761ef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:09:57.875336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845fb9-ab79-4a9a-a8fd-4e016533929e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.876001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845fb9-ab79-4a9a-a8fd-4e016533929e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.876474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845fb9-ab79-4a9a-a8fd-4e016533929e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.878037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 93/181] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:57.883873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101f4e-d3d8-4767-84f0-dedae3aaf732 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:57.884455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101f4e-d3d8-4767-84f0-dedae3aaf732 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:57.884949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101f4e-d3d8-4767-84f0-dedae3aaf732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:57.905373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f3101f4e-d3d8-4767-84f0-dedae3aaf732 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:57.907229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f3101f4e-d3d8-4767-84f0-dedae3aaf732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:57.985324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:58.160071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd60b9-183f-4b82-9a27-73dc23207799 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.160262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd60b9-183f-4b82-9a27-73dc23207799 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.160536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd60b9-183f-4b82-9a27-73dc23207799 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.161901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 94/183] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:09:58.167220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.167502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.167773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.186780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa6e6-0a20-4d54-922b-798b71a77379 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.187078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa6e6-0a20-4d54-922b-798b71a77379 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.187369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa6e6-0a20-4d54-922b-798b71a77379 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.189083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 95/184] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:09:58.192213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:58.193461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:58.194501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.194984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.195482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.213382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:58.214862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:09:58.276035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 90/185] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:09:58.277336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.292966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 96/186] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:09:58.340484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:58.394533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83206891-5a49-4576-bc6f-47b8c3d211cd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.430247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.430807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.431078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.431375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.441977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:58.446796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:58.447656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:09:58.448452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 91/187] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:58.455688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.528359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:58.563796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.568018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330421a-c621-4aed-991f-6609ff289e8b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.601979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.602591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.602869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.603138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.603827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:58.604127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:58.605539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:58.613855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 97/188] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:58.614661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.675004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcda5-14ff-438a-af24-464d28b90150 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.691526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:58.716172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.716809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.717082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.717348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.718447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:58.719988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:58.720878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3012-9c31-4be0-9068-4299a61d2c48 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.721778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 92/189] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:58.724038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.746452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:58.758885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.759611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.759895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.760163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.771386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:09:58.777513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:09:58.778373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:09:58.779148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 98/190] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:09:58.780630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.856709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c14c-ddb3-494e-a2a8-3b49574c3f34 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.892202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.892837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.893113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.893384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.897753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d302c21-5761-4744-acda-a2c7c67e1ecd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:58.910853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:58.912964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:58.914621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 93/191] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:58.915418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:58.940611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:58.941317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:58.941645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:58.941863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:58.942523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:58.944474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:58.964428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:58.969657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 99/192] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:09:58 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:09:58.970289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.021381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.060361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee41-7c5f-4eba-9a10-b19c39adab60 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.099825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d450e25-6c87-47dd-96d9-9b80d4e80677 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.117220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.118518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.119100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.119400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.120080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:59.120686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.121866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.132157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 94/193] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:59.137944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.140876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.141497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.141803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.142039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.227752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.229301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.262983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.267665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2897c2-9f3d-42f2-a4d5-535bb5c7ec1e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.283819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.314479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.315571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.315830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.316099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.317860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.319554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.321553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 95/194] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:09:59.327748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.355833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:09:59.363732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.455579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6465b-7bbb-4601-9454-c6defbf2dd5f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.493693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.494646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.495108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.495562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.499118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238721e-3a68-4ba2-a253-e33c6f99fe87 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.543552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.544517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.544965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.545429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.546754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.546857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.549322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.551876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 101/196] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:59.560400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.575898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.598847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.601205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.700465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2fb6-e07e-4874-9c23-0c002e304d08 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.720971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 96/197] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:09:59.726680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.773198 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.774209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.774704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.775170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.776113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=3bca3751473b413d830d5781dd0651a1) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:09:59.776622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.778267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928045e-6dc6-4c43-aac8-dd3c362b34b7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.792141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 102/198] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/role_assignments?user.id=3bca3751473b413d830d5781dd0651a1&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:59.842459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:09:59.880587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b9c7-265f-41a6-90b5-d80bab53a75b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:09:59.920310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255632-4d21-4069-a0e6-bd419021e546 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.920642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255632-4d21-4069-a0e6-bd419021e546 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.920871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255632-4d21-4069-a0e6-bd419021e546 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.922331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 103/199] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:09:59.928476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.928897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.929271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.932604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:09:59.933251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:09:59.933525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:09:59.933789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:09:59.936877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:09:59.940903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:09:59.941318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 97/200] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:09:59.947483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:09:59.950150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:09:59.952061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:00.029510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 104/201] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:00.074846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09abd4-8a53-467d-b3fc-ec5fc543db70 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:00.109334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:00.110452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:00.110869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:00.111297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:00.112254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=3bca3751473b413d830d5781dd0651a1) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:00.112696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:00.114345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:00.117434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:00.121312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 98/202] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:09:59 2022] GET /identity/v3/role_assignments?user.id=3bca3751473b413d830d5781dd0651a1&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:00.393921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:00.396578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:00.504878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee766e0a-03f4-45a4-93e5-2489dbee5648 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:00.555781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:00.556423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:00.556698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:00.556963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:00.571150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:00.580271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:00.581164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:00.581925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 105/203] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:00.589084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:00.730344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494579a-6b26-452c-a0b6-360abf6a27bb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:00.765565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:00.766230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:00.766502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:00.766767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:00.767461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:00.767756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:00.769135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:00.777822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 99/204] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:00.783720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:00.878351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:00.933803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84a0-f7c1-49a4-9db6-669d06bf3e86 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:00.978771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:00.979437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:00.979712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:00.979977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] PATH_INFO: `/v3/users/64ba663188004f73b4eac9a946902f80` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:00.981161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] RBAC: Authorizing `identity:get_user(user_id=64ba663188004f73b4eac9a946902f80)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:00.982571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:00.984195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 106/205] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:00 2022] GET /identity/v3/users/64ba663188004f73b4eac9a946902f80 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:00.990156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:01.064949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:01.117360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995028e5-42c5-4268-a9ef-90b2a144436b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:01.167233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:01.168250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.168757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.169233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.254296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:01.256133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017f444-57ee-4d56-8bd8-2e085f3965bd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:01.332776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:01.380043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 100/206] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:01.386043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:01.506943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4516d-4586-4852-9e47-04c3f8085956 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:01.522315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b11b-f723-44f9-a292-54f959dc8f1f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.522936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b11b-f723-44f9-a292-54f959dc8f1f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.523458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b11b-f723-44f9-a292-54f959dc8f1f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.525014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 101/207] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:01.540584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef547-0bb9-4069-bddb-1425486c627b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.541167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef547-0bb9-4069-bddb-1425486c627b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.541636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef547-0bb9-4069-bddb-1425486c627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.552975 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:01.553625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.553898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.554167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.555312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:01.555830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:01.558336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:01.562941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:01 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:01.568826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:01.586036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c6bef547-0bb9-4069-bddb-1425486c627b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:01.587276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c6bef547-0bb9-4069-bddb-1425486c627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:01.698154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 102/209] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:01.754963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdbee6-1224-4627-b306-280597e4ccac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:01.756876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ebf73-9450-4a83-9eb2-1bd43c87f2c9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.757360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ebf73-9450-4a83-9eb2-1bd43c87f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.757573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ebf73-9450-4a83-9eb2-1bd43c87f2c9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.758931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 103/210] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:01.763847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.766038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.766534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.797469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:01.799920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:01.814599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:01.815225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:01.815523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:01.815789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:01.816804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, scope.project.id=c9feb52043d54506826645d74efab4bd, user.id=64ba663188004f73b4eac9a946902f80) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:01.816804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:01.818233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:01.830837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 108/211] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:01 2022] GET /identity/v3/role_assignments?user.id=64ba663188004f73b4eac9a946902f80&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=8411a91add674e5e8dc01f766f6761ef => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:01.874157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:02.017177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.089211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.132115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52fda2-d1f1-4873-bba9-54eee44083de None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.173023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.174060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.174528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.174985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.186888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:02.192711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:02.193588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:02.194348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:02.196602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 109/213] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:02.202587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.227593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.247925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.315887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8edbc-2139-47e8-88b4-ca7d332b6394 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.361584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.362212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.362484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.362747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.363509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:02.363805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:02.365199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ac37e-aa13-4ef3-aaa0-c4abd1741d45 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:02.365608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18eea6-c213-4cc8-bd10-d38eb1b64bc1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.377125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 105/214] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:02.381745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b2a0-fc7b-4022-8719-d2da1a51b437 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.382056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b2a0-fc7b-4022-8719-d2da1a51b437 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.382329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b2a0-fc7b-4022-8719-d2da1a51b437 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.383719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 106/215] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:02.387557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44b2a0-fc7b-4022-8719-d2da1a51b437 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.401171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.414427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.415072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.415378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.415662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.416800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:02.418294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e210e-fd84-402b-9cb2-bc93930cb2a8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:02.420150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 110/216] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:02.421181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.421466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.421728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.447414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:02.448595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:02.488307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.507988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44b2a0-fc7b-4022-8719-d2da1a51b437 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.523391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 111/217] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:02.524044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.552263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.552946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.553224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.553488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] PATH_INFO: `/v3/users/e14c873edca04de9a6c0c6f4fd0993bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.568340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=e14c873edca04de9a6c0c6f4fd0993bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:02.570389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf4af6-b518-490f-8a4e-618916b9b9f0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:02.572257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 107/218] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/users/e14c873edca04de9a6c0c6f4fd0993bd => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:02.573213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d48b5-b8ab-4174-af20-c482397506c4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.573485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d48b5-b8ab-4174-af20-c482397506c4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.573734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d48b5-b8ab-4174-af20-c482397506c4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.575142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 108/219] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:02.578366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d48b5-b8ab-4174-af20-c482397506c4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.632970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6fa83-31b8-4408-a76c-6e62060e2c9a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.654625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.669713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.670327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.670603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.670869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.671543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:02.673464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4993-7eb9-468b-b8c3-d914dccc5c17 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:02.682335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d48b5-b8ab-4174-af20-c482397506c4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.696046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 112/220] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:02 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:02.697091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.697373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.697642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.717232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:02.718434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:02.749293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.751592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.752173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.753091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.774592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.812590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 113/221] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:02.813475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:02.851051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:02.853054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:02.933589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661b3c-c474-42fe-8014-41afd321eb61 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:02.944157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:02.988322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:02.988977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:02.989256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:02.989530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:02.990573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:02.996618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.005158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:03.010234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:03.011121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:03.011980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 114/223] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:03.018687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.054169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.137479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97a565-ca95-45ca-a9d8-9f51931875fe None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.146135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771844-5db7-4a6f-961a-eca78378b637 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.182068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.182906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.183182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.183482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.185094 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.186758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.188843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 110/224] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:02 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:03.189506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.189756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.190553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.191003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.191483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.192621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:03.193099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.195668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.207259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 115/225] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:03.212459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.245005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.315779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d01c8-85d7-43a6-8f14-ee60d9aa1cb2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.316787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761def-31ad-41a5-974c-c4890bf9a121 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.327651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.350846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.351624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.351913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.352182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.353247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=e14c873edca04de9a6c0c6f4fd0993bd) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:03.353663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.355434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.356680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.357592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.358010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.358419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.362105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 116/226] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/role_assignments?user.id=e14c873edca04de9a6c0c6f4fd0993bd&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:03.363091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.371524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:03.377802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:03.378766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:03.379582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:03.381708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 111/227] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:03.388241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.473861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.487057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead6ca-f481-422c-b04d-b78d9f95ccbd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.539149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aace04-6ac5-416b-9acb-170140955d1a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.578046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.579242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.579694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.580132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.581261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.581381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.582151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.582667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.582984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.583315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.584153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:03.584624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.585038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 117/228] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:03.590592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.591475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.601600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 112/229] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:03.610057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.671325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.726371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23686ec3-36b4-47b7-884b-2d0ff36a4822 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.800951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.801601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.801878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.802146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.803407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.804835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.805158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f329-4abd-4e6c-ab22-9a8e66617329 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:03.806669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 118/230] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:03.813040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.843181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:03.844298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:03.844988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:03.845442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:03.846762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:03.848394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:03.850176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 113/231] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:03.859281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:03.871560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:03.987100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4022ca-3e27-423e-a63d-13e3417eba76 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:04.020962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:04.024553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1279b-2f70-4296-a5e3-b87b018d6282 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:04.062054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:04.063139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:04.063814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:04.064264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:04.065561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:04.067246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:04.069197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 114/232] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:03 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:04.075366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:04.096464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:04.097164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:04.097442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:04.097714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/3bca3751473b413d830d5781dd0651a1/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:04.104235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, user_id=3bca3751473b413d830d5781dd0651a1, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:04.105679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148cab2-6f92-452c-a097-2e1066c7550f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:04.145730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 119/233] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:03 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/3bca3751473b413d830d5781dd0651a1/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:10:04.196417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3fdc-a5b4-4804-85c0-332651210177 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:04.235510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:04.236818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:04.237329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:04.237747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/3bca3751473b413d830d5781dd0651a1/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:04.240396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, user_id=3bca3751473b413d830d5781dd0651a1, role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:04.242065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853886d6-a48a-4834-b1e8-b4050c0ff5b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:04.265771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 115/234] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:04 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/3bca3751473b413d830d5781dd0651a1/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:04.966046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618aac-04d8-488a-80c3-e3dbe178be79 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:04.966567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618aac-04d8-488a-80c3-e3dbe178be79 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:04.966567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618aac-04d8-488a-80c3-e3dbe178be79 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:04.967970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 120/235] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:04.980611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057927-b215-4433-b4b0-98e7d0e7c567 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:04.981090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057927-b215-4433-b4b0-98e7d0e7c567 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:04.981191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057927-b215-4433-b4b0-98e7d0e7c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.008307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-33057927-b215-4433-b4b0-98e7d0e7c567 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:05.009517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-33057927-b215-4433-b4b0-98e7d0e7c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:05.040800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:05.100399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:05.133113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8c2f-b0a7-4f05-84ec-85670e420f1c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.133414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8c2f-b0a7-4f05-84ec-85670e420f1c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.133667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8c2f-b0a7-4f05-84ec-85670e420f1c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.135314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 121/237] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:05.140503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.141186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.141653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.168249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:05.169511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:05.255071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:05.383983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b8c2f-b0a7-4f05-84ec-85670e420f1c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:05.476576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:05.490773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b8c2f-b0a7-4f05-84ec-85670e420f1c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:05.525771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:05.526323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.526596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.526859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.537811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-af4ffaac-17b8-4d7b-8935-05c631404227 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:05.543062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:05.543953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:05.544745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 122/239] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:05.550100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:05.642080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:05.655235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723b59-2046-46a5-aa87-8f622b2f457b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:05.691748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:05.692371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.692640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.692900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.693571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:05.693863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:05.696851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5dbcc-4111-4a80-ac97-1f4fef0dcc87 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.697130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5dbcc-4111-4a80-ac97-1f4fef0dcc87 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.697394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5dbcc-4111-4a80-ac97-1f4fef0dcc87 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.697716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:05.698985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 123/240] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:05.704612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.705014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.705405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.711700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 118/241] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:05.719225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:05.734146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:05.734146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:05.814430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 124/242] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:05.820174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:05.869400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b410be-10b3-4059-8cea-2a3fa3ac8aab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:05.940067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:05.940735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:05.941011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:05.941282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] PATH_INFO: `/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:05.963884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] RBAC: Authorizing `identity:get_user(user_id=8ca1950f89b34133ae37fb7f5d0ca8a6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:05.965372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:05.967049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 119/243] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:05 2022] GET /identity/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:05.972718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:05.983539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:05.992364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.005424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2bfd-1611-4e0d-8bd6-813c33cfbbf5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.050938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.051608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.051886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.052157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.053328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.054825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.056533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 125/244] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:06.062842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.081309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a387e-2074-4e91-9485-f0e65a63ed5e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.138725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.139484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.139821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.140154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.204271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde5ae-13d6-42b3-86a5-81aaabc0577e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.253493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.254475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.254940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.255439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.256304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.257934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.260212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.261695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.274982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.283268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 126/245] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:06 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:06.284561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.291561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.401463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514c48-b4e4-4d84-94cc-40f447a43896 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.440018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.441016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.441711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.442174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.455629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 120/246] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:06.456554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.459899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:06.465974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:06.466900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:06.467747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:06.473521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 127/247] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:06.479653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.583570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.610087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130968-007d-4260-bdb6-7c2b7cfd0744 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.622143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.638756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a507a44-262f-4b75-9a0c-3a8f026fb774 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.652480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.653223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.653649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.653924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.655725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.657418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40852fb-afa9-4db9-8714-0ca7c276f01b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.659603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 121/248] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:06.660805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85c78-e9f7-41ea-8ea8-c84c9e7307ab None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.661053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85c78-e9f7-41ea-8ea8-c84c9e7307ab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.661324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85c78-e9f7-41ea-8ea8-c84c9e7307ab None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.663529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 122/249] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:06.666455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85c78-e9f7-41ea-8ea8-c84c9e7307ab None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.681421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.682354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.682631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.682905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.683612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:06.683916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.685298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51169-567a-43d2-9f69-bf75f8f06a11 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.697528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 128/250] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:06.698989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.699301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.699571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.718832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:06.722572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:06.803122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85c78-e9f7-41ea-8ea8-c84c9e7307ab None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.808437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 129/251] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:06.809302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:06.843651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.844572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.844990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.845266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.845999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=8ca1950f89b34133ae37fb7f5d0ca8a6) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:06.846478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.848040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b18e1e-c63f-4f79-b3d9-1ae0631610a3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.855403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 123/252] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/role_assignments?user.id=8ca1950f89b34133ae37fb7f5d0ca8a6&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=8411a91add674e5e8dc01f766f6761ef => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:06.856663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9315-8dae-4d97-bbb5-784cca37e7ab None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.856942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9315-8dae-4d97-bbb5-784cca37e7ab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.857209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9315-8dae-4d97-bbb5-784cca37e7ab None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.858586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 124/253] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:06.865033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.867542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.869292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.881990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.889536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:06.892120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:06.931671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:06.932410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a51f-260b-4194-9d65-52e79fa0e501 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:06.976725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 125/254] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:06.978568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:06.979273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:06.979553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:06.979823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] PATH_INFO: `/v3/users/e14c873edca04de9a6c0c6f4fd0993bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:06.980973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] RBAC: Authorizing `identity:get_user(user_id=e14c873edca04de9a6c0c6f4fd0993bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:06.982437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:06.984168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 130/255] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/users/e14c873edca04de9a6c0c6f4fd0993bd => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:06.990914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.103382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56f9e3-4da0-4db1-af54-19cfef6872ff None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.114249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.152770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.153420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.153693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.153955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.158213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:07.162028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:07.169519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:06 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:07.175340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.249148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:07.288540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d8182-8c51-4210-af83-bdddb8095989 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.335566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:07.353547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c708c5-426b-450a-adcd-c6659c33ae19 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.363929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.364583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.364854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.365124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.377295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:07.382094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:07.382944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:07.383736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:07.384455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:07.385267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.439993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.440674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.440951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.441223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/e14c873edca04de9a6c0c6f4fd0993bd/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.443216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, user_id=e14c873edca04de9a6c0c6f4fd0993bd, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:07.444695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:07.475641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 127/258] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:07 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/e14c873edca04de9a6c0c6f4fd0993bd/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:07.476417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.502028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de626f-e9b2-4384-b331-eb5d9a855713 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.538695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.539408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.539696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.539964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.551686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:07.556730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:07.557607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:07.558456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 132/259] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:07.563786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.639628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:07.678478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d4fa-829b-4213-871d-cf6b91e71106 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.716826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.717439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.717711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.717978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.718636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:07.718987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:07.720409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:07.729752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 133/260] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:07.735466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.797883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:07.806898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0727-9936-4620-9523-06a3c3dba59e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.838368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e212-59df-483f-ac30-fe1b3eb21da3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:07.840746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:07.864263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.864980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.865353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.865629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.866310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:07.866607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:07.868510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:07.873200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:07.873843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:07.874114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:07.874378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:07.875573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:07.877004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:07.878767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 134/261] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:07.884145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.888127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 128/262] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:07.894474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:07.984738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1607-7508-444e-9824-85bdf2ed1835 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:08.021310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:08.021922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:08.022196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:08.022459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:08.097710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:08.099169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559cb2-a613-42e4-829f-95be5382643a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:08.152186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:08.153650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:08.155808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:08.156665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:08.156929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:08.157158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] PATH_INFO: `/v3/users/3bca3751473b413d830d5781dd0651a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:08.159133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] RBAC: Authorizing `identity:get_user(user_id=3bca3751473b413d830d5781dd0651a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:08.160593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:08.167254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 129/263] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/users/3bca3751473b413d830d5781dd0651a1 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:08.173121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:08.228177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:08.281077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 135/264] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:08.286647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:08.357430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:08.387895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81d29-e067-4acb-a4d6-1900b411d635 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:08.410273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e290-0f70-4b97-8a4b-e4d9ff1633cb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:08.423613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:08.424397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:08.424772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:08.425134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:08.431242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:08.431242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:08.431242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 136/265] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:08 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:08.435820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:08.511619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:08.512643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:08.513114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:08.513669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:08.585289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd506-e91d-4e9b-884b-4ed27cb18e18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:08.638795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:08.639440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:08.639723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:08.640043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:08.640998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=3bca3751473b413d830d5781dd0651a1) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:08.641311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:08.642791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:08.649634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 137/266] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:08 2022] GET /identity/v3/role_assignments?user.id=3bca3751473b413d830d5781dd0651a1&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:08.686456 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:08.688297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:08.734216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:08.819352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 130/267] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:08.825219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:08.829501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:08.954724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2088f-d1b8-47ad-9a53-4dcdc021631e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:09.001801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:09.003216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.003672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.004104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.007892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:09.009523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda457d4-a0d8-4c95-a8ef-78d941356bc0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:09.011382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 138/268] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:08 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:09.018017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:09.147168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598170a5-ef69-4da3-8cc4-23677d14071e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:09.175566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:09.184265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:09.184861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.185135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.185409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.186137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=3bca3751473b413d830d5781dd0651a1) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:09.186441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:09.187978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d515a9-f20b-4a3b-b6c2-4741dea8ba89 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:09.194048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 131/269] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:09 2022] GET /identity/v3/role_assignments?user.id=3bca3751473b413d830d5781dd0651a1&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:09.305212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e3bd-2130-4c3c-bbd2-b7fdb9d2cf63 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.305563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e3bd-2130-4c3c-bbd2-b7fdb9d2cf63 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.305756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e3bd-2130-4c3c-bbd2-b7fdb9d2cf63 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.307470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 139/270] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:09.320917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40405c9-f74e-41f2-bdb4-004a5157b600 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.321225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40405c9-f74e-41f2-bdb4-004a5157b600 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.321467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40405c9-f74e-41f2-bdb4-004a5157b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.344399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f40405c9-f74e-41f2-bdb4-004a5157b600 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:09.345707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f40405c9-f74e-41f2-bdb4-004a5157b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:09.424524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 132/271] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:09.688116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3401bd-c148-4ea0-a783-22c34cacb325 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.688509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3401bd-c148-4ea0-a783-22c34cacb325 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.688817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3401bd-c148-4ea0-a783-22c34cacb325 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.690193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 140/272] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:09.697872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e23fd-9335-47db-8d12-1e5edaf9e65f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.698152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e23fd-9335-47db-8d12-1e5edaf9e65f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.698428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e23fd-9335-47db-8d12-1e5edaf9e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.702053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3401bd-c148-4ea0-a783-22c34cacb325 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:09.726686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-013e23fd-9335-47db-8d12-1e5edaf9e65f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:09.727957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-013e23fd-9335-47db-8d12-1e5edaf9e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:09.797581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:09.806386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 133/273] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:09.807572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df37e6f-d960-440d-a263-13014b16ca2f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.807856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df37e6f-d960-440d-a263-13014b16ca2f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.808332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df37e6f-d960-440d-a263-13014b16ca2f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.813526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 134/274] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:09.814692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.814968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.815256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.833225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:09.834389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:09.836649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3401bd-c148-4ea0-a783-22c34cacb325 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:09.882866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:09.884014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:09.884776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:09.885586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:09.886157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:09.905183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:09.910601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 135/275] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:09.912944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:09.913815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:09.914664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:09.921454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 141/276] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:09.922498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.033292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2bea4-f05c-4450-b0fb-bd7e97812c7f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.070475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.071083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.071385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.071649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.072307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:10.072601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.073985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.080420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.082999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 136/277] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:10.089724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.139488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.201475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ce7e-fd3b-49a9-a571-fc12092134d6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.207239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecca254-f53b-46bf-ac54-5ca6e53bb2f1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.239323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.239724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.240614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.240956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.241170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] PATH_INFO: `/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.246900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.247838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.248314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.248825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.256009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cf81c9a958424eab6d05d28a5ac3ef)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.257485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.259130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 137/278] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:10.261737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:10.264288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:10.267918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:10.268767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:10.269539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:10.273805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 142/279] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:10.274565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.369068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069585f-a804-40b1-bfcf-cddc801127b8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.370875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.383454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a5aa-8224-4d13-939d-fc409b8a6fba None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.405982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.406763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.407035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.407409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.408531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.409954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.415295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 138/280] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:10.415295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.419632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.420695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.421188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.421689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.423077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, user.id=c7cf81c9a958424eab6d05d28a5ac3ef, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:10.424243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.427129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf5988-da55-421a-a1ed-c8cdd2691afa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.432747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 143/281] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/role_assignments?user.id=c7cf81c9a958424eab6d05d28a5ac3ef&scope.system=all&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:10.433909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c1d3-f281-45c4-9b71-bfeffa0774ad None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.434191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c1d3-f281-45c4-9b71-bfeffa0774ad None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.434465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c1d3-f281-45c4-9b71-bfeffa0774ad None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.435692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 144/282] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:10.440273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c1d3-f281-45c4-9b71-bfeffa0774ad None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.515162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.542834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af74b1-2f0b-4b5c-8bb4-01c76e723b6d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.564619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c1d3-f281-45c4-9b71-bfeffa0774ad None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.583355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.584114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.584393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.584666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.585337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:10.585634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.587044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11de65-241d-4b9a-95d8-c68c2dcba0e9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.601440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.602104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.602380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.602644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.602884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 139/283] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:10.603343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.604754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.608887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.609167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.609486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.627116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 145/284] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:10 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:10.627899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.629717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:10.630905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:10.664269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.724238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 140/285] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:10.769343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8992-f7ec-42b4-851a-91e3dd024828 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.785582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:10.806602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.807803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.808078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.808346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] PATH_INFO: `/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.809478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] RBAC: Authorizing `identity:get_user(user_id=8ca1950f89b34133ae37fb7f5d0ca8a6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.810944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.813166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 146/286] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:10.818501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:10.931469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cabeeb-2f83-42f8-ae43-5d86f48e9111 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:10.968181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:10.969194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:10.969753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:10.970240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:10.971537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:10.972991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:10.975002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 141/287] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:10 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:10.980682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:11.006584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:11.051462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:11.124275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a9c0-c7b7-4438-a8a5-e600f5992818 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:11.133675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922cbb-2173-4f2c-a822-290d26206b6f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:11.163919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:11.164740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:11.165120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:11.165493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/8ca1950f89b34133ae37fb7f5d0ca8a6/roles/8411a91add674e5e8dc01f766f6761ef` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:11.167637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, user_id=8ca1950f89b34133ae37fb7f5d0ca8a6, role_id=8411a91add674e5e8dc01f766f6761ef)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:11.169188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:11.178619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:11.179359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:11.179639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:11.179913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:11.191769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 147/288] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:10 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/users/8ca1950f89b34133ae37fb7f5d0ca8a6/roles/8411a91add674e5e8dc01f766f6761ef => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:11.200192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:11.205951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:11.209464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:11.210951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 142/289] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:11.216764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:11.267261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:11.361827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e960-b301-4f52-bd1a-fbb5404ecc10 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:11.411735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:11.412367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:11.412647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:11.412916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:11.413595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:11.413898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:11.415311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:11.424746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 148/290] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:11.430157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:11.547285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:11.562205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95f870-9299-4bf5-a3fd-0de25ab8deb2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:11.619054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:11.619783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:11.620066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:11.620339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] PATH_INFO: `/v3/users/e14c873edca04de9a6c0c6f4fd0993bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:11.622891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] RBAC: Authorizing `identity:get_user(user_id=e14c873edca04de9a6c0c6f4fd0993bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:11.624448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:11.626357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 143/291] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:11 2022] GET /identity/v3/users/e14c873edca04de9a6c0c6f4fd0993bd => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:11.632197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:11.762187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094668-4759-4da8-a495-6535352f1914 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:11.764071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:11.812140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:11.813244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:11.813817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:11.814277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:11.907922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:11.910166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:12.051328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 149/292] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:12.056936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:12.202852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496d86-d93e-41e3-944d-44b95ed8cc9d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:12.247015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:12.247818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:12.247998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:12.248232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:12.251886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:12.253435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19c86-7942-43db-a62c-ae3b868608f0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:12.255499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 144/293] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:12 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:12.264315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:12.266917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:12.400828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271d7d-0a7a-4f4b-b02e-0c7a0140d364 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:12.451037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:12.451721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:12.452006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:12.452283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:12.453091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=e14c873edca04de9a6c0c6f4fd0993bd) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:12.453408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:12.454861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf78e0-ca0e-4f10-83bf-254c7f383931 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:12.461422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 150/294] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:12 2022] GET /identity/v3/role_assignments?user.id=e14c873edca04de9a6c0c6f4fd0993bd&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:12.599564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d966-49c8-4310-9da0-41c4ad9fea0f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:12.599913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d966-49c8-4310-9da0-41c4ad9fea0f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:12.600126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d966-49c8-4310-9da0-41c4ad9fea0f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:12.601704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 145/295] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:12.607046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb08c-b381-407f-ba3d-3d30005ea5ef None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:12.607362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb08c-b381-407f-ba3d-3d30005ea5ef None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:12.607702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb08c-b381-407f-ba3d-3d30005ea5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:12.634275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-af7eb08c-b381-407f-ba3d-3d30005ea5ef None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:12.635532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af7eb08c-b381-407f-ba3d-3d30005ea5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:12.718302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:12.730217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 151/296] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:13.035658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d966-49c8-4310-9da0-41c4ad9fea0f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.069540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.132266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f12d-23d5-4c25-ac6b-7bd0e989d863 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.132581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f12d-23d5-4c25-ac6b-7bd0e989d863 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.132808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f12d-23d5-4c25-ac6b-7bd0e989d863 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.134546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 152/297] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:13.140922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.141173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.141430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.151164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d966-49c8-4310-9da0-41c4ad9fea0f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.164451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:13.166630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:13.195096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.195760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.196037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.196300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.209550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:13.215374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:13.216270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:13.217061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:13.219929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 146/298] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:13.230925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.248084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 153/299] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:13.328421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.344719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab44af-79be-4cfa-a1e0-4ca6313ac0cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.380806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.381417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.381691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.381957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.382623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:13.382925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:13.384338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cb4a6-7de9-423a-87a7-36b81df09dfe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:13.397667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 147/300] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:13.400343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.444296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf4cb6-fad3-4110-831d-167816a19ce8 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.444612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf4cb6-fad3-4110-831d-167816a19ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.444847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf4cb6-fad3-4110-831d-167816a19ce8 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.446197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 148/301] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:13.451009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738b9a-3a3f-44de-8f2a-039ee7e11718 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.451368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738b9a-3a3f-44de-8f2a-039ee7e11718 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.451648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738b9a-3a3f-44de-8f2a-039ee7e11718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.470944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d5738b9a-3a3f-44de-8f2a-039ee7e11718 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:13.472204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d5738b9a-3a3f-44de-8f2a-039ee7e11718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:13.527284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a93fd-57aa-4447-b199-2833548a56b8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.541638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 149/302] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:13.543221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5fcc-ab85-4a26-bf0d-247e1a8bde69 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.543531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5fcc-ab85-4a26-bf0d-247e1a8bde69 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.543800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5fcc-ab85-4a26-bf0d-247e1a8bde69 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.545030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 150/303] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:13.545771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d5fcc-ab85-4a26-bf0d-247e1a8bde69 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.563046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.573031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.573676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.573951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.574219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] PATH_INFO: `/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.575540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] RBAC: Authorizing `identity:get_user(user_id=c7cf81c9a958424eab6d05d28a5ac3ef)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:13.576807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fd496-ffc7-4a8c-854a-595528f0b52f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:13.579154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 154/304] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:13.585390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.585709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.585982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.604426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:13.605602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:13.629724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.655050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d5fcc-ab85-4a26-bf0d-247e1a8bde69 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.675546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 155/305] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:13.676648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.701980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.703159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.703633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.704071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.705863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:13.707889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:13.710175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 151/306] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:13.716440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.784222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88580f-8a6a-4981-a672-96804dddff59 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.809071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.820612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.821274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.821550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.821822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] PATH_INFO: `/v3/system/users/c7cf81c9a958424eab6d05d28a5ac3ef/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.823252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7cf81c9a958424eab6d05d28a5ac3ef, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:13.824644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:13.834907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 156/307] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Sep 2 05:10:13 2022] PUT /identity/v3/system/users/c7cf81c9a958424eab6d05d28a5ac3ef/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:13.835724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.850638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cccb-ddcf-45c9-b813-ccd5fbd2908b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:13.889335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:13.889969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:13.890247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:13.890638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] PATH_INFO: `/v3/groups` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:13.891392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:13.892950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:13.918603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 152/308] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Sep 2 05:10:13 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:13.942330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:13.952813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:13.993710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a052-ba27-4959-aa6a-a22b4f113186 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.036343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.036995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.037267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.037535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.049931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:14.055366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:14.056278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:14.057040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 157/309] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:14.064474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.071473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1954-7656-4311-931f-ca9727649833 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.111465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.112902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.113182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.113443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.124534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:14.126358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:14.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:14.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:14.132570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 153/310] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:14.138605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.203062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea1122-131f-4f28-8082-4fe836dfcfde None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.218126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.246167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.246923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.247330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.248781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.249502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:14.249858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.252057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.254789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81173c01-07ba-4eea-83d1-4a5cbaf18a3c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.261587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 158/311] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:14.267068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.291343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.292252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.292676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.293089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.293896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:14.294364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.295907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.309431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 154/312] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:14.310575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.378077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68644-c88d-4924-8dca-0bf4219ea434 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.389855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.415089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.416532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.416955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.417375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] PATH_INFO: `/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.432394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d3e18f1b54ea583bc3193fb01ae38)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.434235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.435387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2d2ba-bbdc-4873-8425-8d19f1cf6cb9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.437138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 159/313] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:14.442710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.479400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.500219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.501018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.501296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.501565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] PATH_INFO: `/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.503443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] RBAC: Authorizing `identity:get_user(user_id=8ca1950f89b34133ae37fb7f5d0ca8a6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.505636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.507536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 155/314] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/users/8ca1950f89b34133ae37fb7f5d0ca8a6 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:14.513658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.583707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd46f5-f622-4d3b-b769-086df3aa3ea6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.619399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c155-54ce-4936-ad14-958121e92622 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:14.629298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.630625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.631169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.631660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.632784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, user.id=1c0d3e18f1b54ea583bc3193fb01ae38, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:14.633300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.635581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.647779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 160/315] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/role_assignments?user.id=1c0d3e18f1b54ea583bc3193fb01ae38&scope.system=all&role.id=8411a91add674e5e8dc01f766f6761ef => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:14.663003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:14.663742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:14.664019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:14.664279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:14.732940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.741496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:14.743043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:14.859038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 156/316] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:14.865440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:14.898078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:14.972323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96531f-9902-4c5f-87ce-f10a67700205 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:15.007533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:15.008173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.008444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.008709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.009819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:15.011287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640486e-ba63-4687-b716-93f229f3f536 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:15.013292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 161/317] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:14 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:15.020534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:15.121603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:15.127811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a013e-0a0e-4259-aff6-b4130e524138 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:15.163976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:15.164507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.164779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.165045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.165764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, scope.project.id=d093d451cba14c4095c1373f1f4c75d2, user.id=8ca1950f89b34133ae37fb7f5d0ca8a6) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:15.166062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:15.167535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b26b-6b91-451a-a7a0-0c8d50493e71 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:15.173960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 157/318] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:15 2022] GET /identity/v3/role_assignments?user.id=8ca1950f89b34133ae37fb7f5d0ca8a6&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=8411a91add674e5e8dc01f766f6761ef => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:15.808302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6cb4-03c8-4c04-b288-a6e003148c8f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.808871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6cb4-03c8-4c04-b288-a6e003148c8f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.808871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6cb4-03c8-4c04-b288-a6e003148c8f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.810325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 162/319] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:15.815968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003415-588b-4981-917d-7028af836c9a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.816374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003415-588b-4981-917d-7028af836c9a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.816466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003415-588b-4981-917d-7028af836c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.835780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-76003415-588b-4981-917d-7028af836c9a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:15.836970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76003415-588b-4981-917d-7028af836c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:15.909983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 158/320] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:15.948773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e2c6-effa-4146-820a-15dab6a26e8b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.949084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e2c6-effa-4146-820a-15dab6a26e8b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.949299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e2c6-effa-4146-820a-15dab6a26e8b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.950818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 163/321] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:15.956166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:15.956447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:15.956720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:15.976003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:15.977178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:16.046551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 159/322] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:16.177281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e2c6-effa-4146-820a-15dab6a26e8b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.281612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:16.286510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e2c6-effa-4146-820a-15dab6a26e8b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.314333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.323695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.324330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.324820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.324820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.335603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:16.336501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:16.340562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:16.341452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:16.342243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 164/323] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:16.347928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.422183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159ccb1-8dfe-4841-99e1-d2fefbc3c77c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.457688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1992-738a-465f-9243-b566c8e14e15 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.467178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.467807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.468059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.468343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.469900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:16.471403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:16.475239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 160/324] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:16.478495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.517368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.518835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.519109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.519400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.520078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:16.520379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:16.521771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:16.533047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 165/325] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:16.538670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.565775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:16.577735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:16.591329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460054-029e-4dbe-aaef-2447015211af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.625981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.626595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.626871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.627139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] PATH_INFO: `/v3/groups` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.627819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:16.629599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393542-e2b9-4468-a9cd-e128ecddb692 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:16.644891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3225-361d-44f7-b7e9-718a4626ed67 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.646452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 161/326] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Sep 2 05:10:16 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:16.647825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca944-3310-46e0-aae7-78f8d2367252 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.648107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca944-3310-46e0-aae7-78f8d2367252 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.648372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca944-3310-46e0-aae7-78f8d2367252 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.649742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 162/327] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:16.655332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.655607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.655890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.674929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:16.676171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:16.685604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.686669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.686952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.687312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] PATH_INFO: `/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.688689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] RBAC: Authorizing `identity:get_user(user_id=c7cf81c9a958424eab6d05d28a5ac3ef)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:16.690182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:16.697296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 166/328] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:16 2022] GET /identity/v3/users/c7cf81c9a958424eab6d05d28a5ac3ef => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:16.698604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:16.759423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 163/329] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:16.815968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:16.826429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b0ac-2fba-43a5-8725-7975243d4dfd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:16.863026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:16.863908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:16.864189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:16.864460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:16.865201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] RBAC: Adding query filter params (role.id=2b0f7dcbac564f0cab3167129879b22f, user.id=c7cf81c9a958424eab6d05d28a5ac3ef, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:16.865508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:16.866940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:16.879915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 167/330] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Sep 2 05:10:16 2022] GET /identity/v3/role_assignments?user.id=c7cf81c9a958424eab6d05d28a5ac3ef&scope.system=all&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:17.026397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:17.114020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:17.137987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c09e64-b3be-4e39-a8e5-177578bee769 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:17.173152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:17.173866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:17.174148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:17.174421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:17.185378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:17.190784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:17.191701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:17.192457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 164/331] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:17.199095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:17.316658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171d23-77f9-4a65-bfc8-a2601a864d1d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:17.356333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:17.357309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:17.357804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:17.358263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:17.359160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:17.359716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:17.361563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:17.371371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 168/332] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:17.379457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:17.497748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df038-13aa-492d-8324-ef906c78f87c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:17.535765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:17.536407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:17.536683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:17.536941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] PATH_INFO: `/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:17.539897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d3e18f1b54ea583bc3193fb01ae38)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:17.541434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857110-bed1-4b2b-bf03-00692601085b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:17.543343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 165/333] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:17 2022] GET /identity/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:17.549321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:17.564178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:17.659325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311579b4-f5d0-4f8a-8853-e9002ec88f0d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:17.694563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:17.695248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:17.695528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:17.695799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] PATH_INFO: `/v3/system/users/1c0d3e18f1b54ea583bc3193fb01ae38/roles/8411a91add674e5e8dc01f766f6761ef` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:17.697278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c0d3e18f1b54ea583bc3193fb01ae38, role_id=8411a91add674e5e8dc01f766f6761ef)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:17.698740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0740d4e-dcba-4203-b21f-41c9d0c79049 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:17.709101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 169/334] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Sep 2 05:10:17 2022] PUT /identity/v3/system/users/1c0d3e18f1b54ea583bc3193fb01ae38/roles/8411a91add674e5e8dc01f766f6761ef => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:10:18.818921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f84d1-dace-4de4-903e-25e54a92966f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:18.819528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f84d1-dace-4de4-903e-25e54a92966f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:18.819528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f84d1-dace-4de4-903e-25e54a92966f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:18.821080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 166/335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:18.826490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e790-e6ff-4d71-b90c-0297caabd9f3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:18.826911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e790-e6ff-4d71-b90c-0297caabd9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:18.827080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e790-e6ff-4d71-b90c-0297caabd9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:18.851237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3db0e790-e6ff-4d71-b90c-0297caabd9f3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:18.852505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3db0e790-e6ff-4d71-b90c-0297caabd9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:18.934860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 170/336] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:19.492792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f84d1-dace-4de4-903e-25e54a92966f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:19.503255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:19.521362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadc3b9-692b-420d-a93f-cf58408207bc None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.521362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadc3b9-692b-420d-a93f-cf58408207bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.521609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadc3b9-692b-420d-a93f-cf58408207bc None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.523140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 171/337] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:19.528397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.528676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.528944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.544386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:19.564296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:19.565522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:19.635566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f84d1-dace-4de4-903e-25e54a92966f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:19.680981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:19.681982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.682263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.682537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.697183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-306abfa6-1b7a-4cc4-b42a-9ede6869b839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:19.702521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:19.703461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:19.704216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:19.704792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 167/338] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:19.706029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd52c-93fb-4531-bd4b-d998bbbb1bbd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.706312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd52c-93fb-4531-bd4b-d998bbbb1bbd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.707216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd52c-93fb-4531-bd4b-d998bbbb1bbd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.708614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 168/339] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:19.714317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.715078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.715391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.736654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:19.738173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:19.761051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 172/340] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:19.761960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:19.821690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:19.835688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 169/341] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:19.937238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0800b-2f7a-4da4-bf3a-d3ca2df4e974 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:19.979551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:19.980168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:19.980445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:19.980716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:19.981389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:19.981688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:19.983061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:19.984543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:19.993549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 173/342] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:19.998689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.119331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25095-1049-4a00-a9ab-af16201aa4f1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.157161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.160167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.160802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.161080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.161346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.242014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:20.252554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:20.254297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:20.278138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efaba9-b524-449c-85fc-7bf13d265d4e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.314951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.315679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.315965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.316240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.327022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:20.332857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:20.333751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:20.335874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 174/343] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:20.344322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.386834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 170/344] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:20.388803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.413959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:20.472517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710296-9371-4dd3-b521-707c39a6e952 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.527468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.528955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.529711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.530459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.533909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:20.534226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:20.535964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798954a1-5028-4ec6-8718-cd6f97bcf733 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:20.553669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 175/345] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:20.554935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb57b-6b74-4d5f-a207-d81c9f55454a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.555070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f535a3-a06f-4632-b181-fb0d2282f7a5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.555330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f535a3-a06f-4632-b181-fb0d2282f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.555608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f535a3-a06f-4632-b181-fb0d2282f7a5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.557017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 176/346] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:20.557894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f535a3-a06f-4632-b181-fb0d2282f7a5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.559821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:20.596279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.597330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.597807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.598283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.599873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:20.601780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:20.603918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 171/347] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:20.604931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.696037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f535a3-a06f-4632-b181-fb0d2282f7a5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.719810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:20.720789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132a10-ed33-4bb6-bd79-3fc2b7816dc3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:20.738657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.739316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.739593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.739859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.759238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:20.762833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:20.763783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7656c049-ae47-4dbd-8dfb-0e2f974326a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:20.764078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:20.765000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:20.765874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:20.767393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.768071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.769335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 177/348] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:20.770625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:20.770910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:20.771180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:20.794496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:20.795722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:20.806436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:20.848919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:20.851368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:20.871847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 178/349] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:20.874347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.967801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 172/350] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:20.969064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:20.997656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5426656-3ce0-444c-8779-b3eae078f3fd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.009168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.040184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.040817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.041092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.041362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.043260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.050549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.052771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.058708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 179/351] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.059567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.089874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870022f-4ab5-4e79-b26b-a1c468e70420 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.127170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.128184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.128682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.129147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.130019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:21.130517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.132108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786131-8ec5-4e0a-bb12-31c8f2752b11 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.141401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 173/352] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.142934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ded02-fce2-48ad-b31d-f64402b98e12 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.143503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ded02-fce2-48ad-b31d-f64402b98e12 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.143990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ded02-fce2-48ad-b31d-f64402b98e12 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.145450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 174/353] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:21.146595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ded02-fce2-48ad-b31d-f64402b98e12 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.177644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85359f68-2981-4e42-be14-5483c39c5811 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.216692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.218050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.218857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.219413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.220990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.223375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.225458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 180/354] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.227007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.277719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ded02-fce2-48ad-b31d-f64402b98e12 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.278785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.310601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.321753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.322373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.322652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.322925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.323691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=c9feb52043d54506826645d74efab4bd) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:21.323998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.325462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa137-eac0-46a7-9199-f50159e3fa39 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.333180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 175/355] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.334674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.334951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.335294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.347255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0578e-8102-423d-b0ed-a6ec73b25379 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.357684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:21.359985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:21.395933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.396680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.396964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.397239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.447769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 176/356] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:21.455232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.484877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.486491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.538213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.610687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 181/357] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:21.610687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.617956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75222-80cd-4147-88ab-c276e158e3ca None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.648138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.677330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.678060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.678473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.678716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.680077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.681657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9bf1-cd20-4f39-8ef1-2fcf5c27379f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.683389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 177/358] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.684582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e582c-e6cd-4774-a29e-f2c793ffe7b9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.684866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e582c-e6cd-4774-a29e-f2c793ffe7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.685136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e582c-e6cd-4774-a29e-f2c793ffe7b9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.687638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 178/359] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:21.688394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e582c-e6cd-4774-a29e-f2c793ffe7b9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.739543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c137-191b-4edd-8011-5ae20239a326 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.787094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.787915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.788199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.788473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.798070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.801718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:21.806850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:21.807842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 05:10:21.808658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:21.812295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 182/360] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:21.814022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:21.830250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e582c-e6cd-4774-a29e-f2c793ffe7b9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.877932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.878533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.878743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.879006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.880690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.882152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138c453-f6b8-4515-8ca2-8eef041ed8a6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:21.885170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 179/361] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:21.886248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.886529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.886796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.915785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:21.917041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:21.944051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edd78-c4a8-4418-ad92-73ee3427a3fb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:21.983276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:21.989738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:21.990354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:21.990626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:21.990896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:21.991658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=d093d451cba14c4095c1373f1f4c75d2) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:21.991982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:21.993708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.003018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 183/362] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:21 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.004261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.008003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 180/363] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:22.009427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.128243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.187147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f4c0-338a-44ce-9216-43d9cbe23fa1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.206406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cad7-b704-4d3c-9fad-dd06e322129e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.232507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.233678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.234016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.234287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.248687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:22.250118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.250730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.251002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.251294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.251961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:22.252253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.253630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:22.254011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:22.254843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:22.255681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:22.256341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 184/364] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:22.257475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.267927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 181/365] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.268773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.355120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.376038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656619-6f57-499a-9699-43e15d2fafef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.404932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.420170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.421032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.421271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.421923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.423308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.425206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.427224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 185/366] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.432108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.435585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777a416-fa05-4d79-a8f0-1c4f9af3c82c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.487140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.488068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.488479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.488884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.489836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:22.490379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.492007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.502186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 182/367] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.503402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.550843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef16b-2dac-4275-a034-40da85672b45 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.589213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.590129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.590129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.591445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] PATH_INFO: `/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.591677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d3e18f1b54ea583bc3193fb01ae38)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.593194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.595312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 186/368] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/users/1c0d3e18f1b54ea583bc3193fb01ae38 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.601170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.622631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2cecc-c1bb-445c-b2da-7b6f3ba5ef4d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.659918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.665126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.666230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.666688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.667097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.667953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.680952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:22.688117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:22.689024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:22.689847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:22.692709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 183/369] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:22.693814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.713309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11855e-7e5c-4e0d-9a64-7d8076120ea9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.750276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.750892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.751164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.751464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.752184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=c9feb52043d54506826645d74efab4bd) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:22.752486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.754224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.760809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 187/370] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.760809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.819101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb142-8c07-4250-8eeb-4edb8dddab55 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.858807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.859803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.860239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.860515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.867414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9596318-494d-4bcc-952d-7771c97c0c61 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:22.894207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.907530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:22.908302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:22.908691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:22.908872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:22.909347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:22.910408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] RBAC: Adding query filter params (role.id=8411a91add674e5e8dc01f766f6761ef, user.id=1c0d3e18f1b54ea583bc3193fb01ae38, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:22.910408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.912204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:22.926684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/role_assignments?user.id=1c0d3e18f1b54ea583bc3193fb01ae38&scope.system=all&role.id=8411a91add674e5e8dc01f766f6761ef => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:22.932032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:22.947666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:22.949629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.066271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 184/372] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:23.084423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeb34-30a2-4284-af9b-77be4cb63662 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.090316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.138052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.138680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.138953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.139242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.139936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:23.140266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.141698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.152820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 189/373] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:23.158914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.223601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.275566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.275889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe788f1-39fc-46c8-b9b8-cb0c195d2f9f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.315842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.316458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.316734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.317004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.325202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828d69-4d05-450e-816e-2a7637f6757e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.392574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.392775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.393720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.394221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.394322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.394790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.396392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.398179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.400520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 185/374] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:23.425010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.451798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.510470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 190/375] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:23.516707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.620701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bac8f1-19d4-46cb-8794-c385e2dac24d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.637609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361b5f3-ff73-408d-8759-a1e3b239fe76 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.657904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.658604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.658881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.659146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] PATH_INFO: `/v3/projects/a9a94747b8f64b12a67048c396b7c9c0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.660298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a94747b8f64b12a67048c396b7c9c0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.661740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.663415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 191/376] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/projects/a9a94747b8f64b12a67048c396b7c9c0 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:23.668851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.684845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.707341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.708361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.708835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.709320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.711965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.713750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.715982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 186/377] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:23.721503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.735571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.775652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833c5a-b441-4892-86a4-ff43e5a1e943 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.814361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.815051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.815908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.816183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] PATH_INFO: `/v3/groups/d86b4b12029a41c6b86a94279b3a3c51` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.826045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] RBAC: Authorizing `identity:get_group(group_id=d86b4b12029a41c6b86a94279b3a3c51)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.827529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.830938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 192/378] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/groups/d86b4b12029a41c6b86a94279b3a3c51 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:23.840761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:23.906811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d31a5-8fb1-41eb-9ed5-dd57ae71bd62 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.939715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:23.950711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:23.951390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.951668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.951930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.952727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=d093d451cba14c4095c1373f1f4c75d2) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:23.953187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:23.955791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa87006-1331-47d6-9865-907ce22de387 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:23.964222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 187/379] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:23.965596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92c6d-4c5f-43d8-84ad-17825e318fb8 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.965870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92c6d-4c5f-43d8-84ad-17825e318fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.966140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92c6d-4c5f-43d8-84ad-17825e318fb8 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:23.967380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 188/380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:23.971880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee565-6e5a-4d65-ab2a-9ab1db814397 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:23.973780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:23.974321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:23.974600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.000797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:24.004006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:24.019692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:24.020314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.020645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.020910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.021680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] RBAC: Adding query filter params (group.id=d86b4b12029a41c6b86a94279b3a3c51, role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=a9a94747b8f64b12a67048c396b7c9c0) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:24.021985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:24.023611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:24.031100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 193/381] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:23 2022] GET /identity/v3/role_assignments?group.id=d86b4b12029a41c6b86a94279b3a3c51&scope.project.id=a9a94747b8f64b12a67048c396b7c9c0&role.id=043be44598c24b52b429eb2a25c1962d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:24.086915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:24.089788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 189/382] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:24.370920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:24.474130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf612-a5e4-41b1-94a0-8c5217e483b6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:24.508432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:24.509075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.509339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.509613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.517722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:24.520603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-afe3c52c-be99-4743-8463-abe0ee6f976e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:24.526185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:24.527179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:24.528006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:24.531304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 194/383] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:24.533759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:24.638798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674aa0-6f66-4e9e-b118-f8ba35b3daa1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:24.644184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0950-ad35-4782-9e77-b0419cbd5d05 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.644465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0950-ad35-4782-9e77-b0419cbd5d05 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.644730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0950-ad35-4782-9e77-b0419cbd5d05 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.646348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 195/384] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:24.652874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.653522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.653800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.678214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:24.679477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:24.691734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:24.692355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.692723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.692992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.693659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:24.693951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:24.695441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:24.708376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 190/385] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:24.714408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:24.763282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 196/386] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:24.798332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:24.855622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb956b-acca-45cb-8fd6-703b554285fe None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:24.898547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:24.899101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:24.899397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:24.899666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:24.900792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:24.902227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:24.904163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 191/387] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:24 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:24.909886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.029404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857a60a-2f27-4d18-82ae-649f1eab2ace None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:25.062495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:25.070338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:25.070982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.071275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.071546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.074510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:25.076061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:25.078045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 197/388] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:24 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:25.083756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.206920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b243-7ef4-48f2-ac6e-96645bb30ee8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:25.243737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:25.256801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:25.257474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.257747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.258011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/groups/c725f2a4d6bf4bf48f607b3def771746/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.259942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, group_id=c725f2a4d6bf4bf48f607b3def771746, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:25.261395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:25.283163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 192/389] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Sep 2 05:10:25 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/groups/c725f2a4d6bf4bf48f607b3def771746/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:25.384172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.494977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3cda9-0f55-4402-bcbb-3567453e1930 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:25.532331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:25.532969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.533245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.533518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.544305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-39679e1a-b551-4af6-9a30-2799d1b1e29e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:25.551300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:25.552249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:25.553107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:25.557502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 198/390] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:25.557723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.558744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472974ef-45a5-4f0b-8892-1488d1e1a721 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.559024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472974ef-45a5-4f0b-8892-1488d1e1a721 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.559328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472974ef-45a5-4f0b-8892-1488d1e1a721 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.563384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 199/391] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:25.568605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.568891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.569169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.595546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:25.596789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:25.659913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:25.675581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 200/392] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:25.692033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4478b-77c6-4d71-8e6c-7d8019342a28 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:25.728599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:25.729210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.729480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.729742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.730403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:25.730696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:25.732131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:25.740917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 193/393] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:25.748709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.864961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd10a27-4fc4-414c-a4e3-b442e24aa4c8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:25.907823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:25.908476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:25.908805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:25.909080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:25.910194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:25.911666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:25.917860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 201/394] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:25 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:25.919436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.988139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:25.990667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.065101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.091782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e768a2-b903-4162-9412-e3547c69baa4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.135000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f723-014b-45cb-a529-bcb51a63a8b6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.159404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.160054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.160325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.160590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.162968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:26.164435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:26.166761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 194/395] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:25 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:26.172132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:26.190208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.191123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.191586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.192137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.205057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:26.211256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:26.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:26.213019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:26.215673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 202/396] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:26.223393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:26.378401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ea66-cbc1-48eb-aab2-abb3d8826758 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.394983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c082-eada-4763-b34b-a4db92b0b261 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.398072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.420557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.422787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.423465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.423788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.424094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.424911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:26.425242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:26.426617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:26.439269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 203/397] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:26.445693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.446610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.447092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.447603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/groups/c725f2a4d6bf4bf48f607b3def771746/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.449496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:26.454630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, group_id=c725f2a4d6bf4bf48f607b3def771746, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:26.460870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:26.483191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 195/398] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Sep 2 05:10:26 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/groups/c725f2a4d6bf4bf48f607b3def771746/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:10:26.606543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3c9a-b85c-45d0-b552-afca8752c9d2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.658050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.659073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.659593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.660070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.661472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:26.663287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12e3c-889b-467b-86a9-c89ffde27091 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:26.669160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 204/399] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:26 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:26.671501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:26.701130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33664-bcc6-4ade-a1ae-6d88ea0c5acf None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.701799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33664-bcc6-4ade-a1ae-6d88ea0c5acf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.702275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33664-bcc6-4ade-a1ae-6d88ea0c5acf None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.704589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 205/400] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:26.712845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb471-6bfc-445e-9f7d-126be2c13b7c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.713486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb471-6bfc-445e-9f7d-126be2c13b7c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.713990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb471-6bfc-445e-9f7d-126be2c13b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.743800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7dfeb471-6bfc-445e-9f7d-126be2c13b7c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:26.746044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7dfeb471-6bfc-445e-9f7d-126be2c13b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:26.789892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e14e-3a3a-4649-85cc-a1a47773e3d9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:26.807313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.829697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:26.830658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.830776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.831012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.832187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:26.833823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0554-2624-48d0-b059-87596831c6a6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:26.839044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 196/401] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:26 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:26.839044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f982-41e5-4c84-bf6e-4c7c67a18633 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.839044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f982-41e5-4c84-bf6e-4c7c67a18633 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.839044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f982-41e5-4c84-bf6e-4c7c67a18633 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.839044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 197/402] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:26.844065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881f982-41e5-4c84-bf6e-4c7c67a18633 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:26.846309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 206/403] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:26.849170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:26.849749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:26.850213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:26.871192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:26.872414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:26.915859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:26.950120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 207/404] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:26.975581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881f982-41e5-4c84-bf6e-4c7c67a18633 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.011579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.012621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.013103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.013576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd/groups/c725f2a4d6bf4bf48f607b3def771746/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.016340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=c9feb52043d54506826645d74efab4bd, group_id=c725f2a4d6bf4bf48f607b3def771746, role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:27.018018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:27.037893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 198/405] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Sep 2 05:10:26 2022] PUT /identity/v3/projects/c9feb52043d54506826645d74efab4bd/groups/c725f2a4d6bf4bf48f607b3def771746/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:27.241835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.273279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.363965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c290eb-4a43-4be6-a700-ae9c4a7cf8f5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.376263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:27.409913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.410531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.410807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.411071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.421849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73531-d4ee-4fc4-ab50-2ba96bfc6fcb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.433543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:27.438337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:27.439496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:27.440514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 208/406] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:27.447074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.447622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:27.514967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.516139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.516622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.517075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.541947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:27.547949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:27.548857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:27.549618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:27.558864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 199/407] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:27.567995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.640233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9903-42ea-492a-87a3-12ef0234feb5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.678438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.679124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.679461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.679736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.680410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:27.680712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:27.682093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:27.692030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 209/408] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:27.697694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.729492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:27.810426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ebaa-62c5-4a73-9ad1-007dace59e8b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.827315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d43b2-71d3-4907-a972-9f3b3e425bcd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:27.851252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.851252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.851252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.851252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.851814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:27.851814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:27.853561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 210/409] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:27.859518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.922870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:27.923751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:27.924027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:27.927387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:27.928171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:27.928486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:27.930141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:27.949709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 200/410] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:27.960250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:27.967589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:27.984004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcafb47-0fe1-464d-b6ad-51fa3164850a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.021545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:28.051999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.052652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.052925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.053191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.055675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:28.057148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:28.060056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 211/411] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:28.065155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:28.130475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b643-e31e-4a87-9a21-16a90a6cdd26 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.169768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.170851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.171609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.172243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] PATH_INFO: `/v3/groups/d86b4b12029a41c6b86a94279b3a3c51` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.173680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] RBAC: Authorizing `identity:get_group(group_id=d86b4b12029a41c6b86a94279b3a3c51)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:28.174748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184962a-4be2-4249-af29-6dff4c7d742c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.176347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965bd4-76d0-463e-9d8a-9d1fad6d499f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:28.178950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 201/412] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:27 2022] GET /identity/v3/groups/d86b4b12029a41c6b86a94279b3a3c51 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:28.180544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f317-6c2f-4e80-a3b1-1c5e33ccaf66 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.181034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f317-6c2f-4e80-a3b1-1c5e33ccaf66 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.183037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249f317-6c2f-4e80-a3b1-1c5e33ccaf66 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.190977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 202/413] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:28.192138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249f317-6c2f-4e80-a3b1-1c5e33ccaf66 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:28.215711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.216458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.216753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.217018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2/groups/c725f2a4d6bf4bf48f607b3def771746/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.219541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d093d451cba14c4095c1373f1f4c75d2, group_id=c725f2a4d6bf4bf48f607b3def771746, role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:28.220988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca395-7ea9-4ffb-9114-4e38c0f184a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:28.239279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 212/414] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Sep 2 05:10:28 2022] PUT /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2/groups/c725f2a4d6bf4bf48f607b3def771746/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:10:28.244358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.245030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.246997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.291427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:28.295329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:28.345631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:28.395424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:28.403118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249f317-6c2f-4e80-a3b1-1c5e33ccaf66 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.427525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 213/415] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:28.478044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.478749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.479027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.479371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] PATH_INFO: `/v3/projects/a9a94747b8f64b12a67048c396b7c9c0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.480510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] RBAC: Authorizing `identity:get_project(project_id=a9a94747b8f64b12a67048c396b7c9c0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:28.481973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:28.483838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 203/416] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:28 2022] GET /identity/v3/projects/a9a94747b8f64b12a67048c396b7c9c0 => generated 344 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:28.490318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:28.604321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4fc9-4beb-4f50-96b1-1832493856d2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.644303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.645286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.645781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.646296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] PATH_INFO: `/v3/projects/a9a94747b8f64b12a67048c396b7c9c0/groups/d86b4b12029a41c6b86a94279b3a3c51/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.648499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a94747b8f64b12a67048c396b7c9c0, group_id=d86b4b12029a41c6b86a94279b3a3c51, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:28.651239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb788e-1b82-4bf0-955f-b745898bf0ca None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:28.671381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 214/417] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Sep 2 05:10:28 2022] PUT /identity/v3/projects/a9a94747b8f64b12a67048c396b7c9c0/groups/d86b4b12029a41c6b86a94279b3a3c51/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:28.733956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:28.854584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb825-374f-4314-ad79-f3fef682dd2c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.854905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb825-374f-4314-ad79-f3fef682dd2c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.855074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb825-374f-4314-ad79-f3fef682dd2c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.856580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 215/418] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:28.862417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.863081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.863609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.883446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:28.885482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:28.898411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:28.908447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24633c5-1b52-496a-808d-9d3b887a2adc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:28.972924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:28.974262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:28.974771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:28.975262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:28.980894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 216/419] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:28.996281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:29.001761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:29.002672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:29.003468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 204/420] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:29.012478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.124435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b64c-877e-4f0b-af53-8b8c99703183 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:29.167535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:29.168168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.168449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.168718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.169396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:29.169697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:29.171135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:29.180625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 217/421] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:29.186394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.220693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:29.308641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.317873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f881f-8e01-4e2e-b49a-64f62d152ebb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:29.327185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:29.371792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:29.372406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.376198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.376425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.499969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e3ad-6ea4-455f-ae41-870683917783 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:29.517434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:29.518924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda533-a1be-43c0-9a65-2cd630d9bd05 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:29.540640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:29.541283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.541557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.541823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.559756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:29.560531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:29.576801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:29.577971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:29.579016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 218/422] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:29.584164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.668169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 205/423] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:29.668169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62718-0b53-472c-b8e0-77623ab9b3b2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.668169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62718-0b53-472c-b8e0-77623ab9b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.668169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62718-0b53-472c-b8e0-77623ab9b3b2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.672976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 206/424] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:29.674277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.674563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.674835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.688673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:29.697191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:29.698367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:29.732331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ffdb-40a6-4560-80f3-8945e814403c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:29.766764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:29.767616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.768040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.768464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.769338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:29.769774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:29.771362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:29.775445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 207/425] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:29.776339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.780389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 219/426] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:29.792154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.834918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:29.883106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ac2ee-0771-474b-8c26-d45cfd991f03 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:29.920689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:29.921809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:29.922229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:29.922636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:29.924107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:29.925772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:29.927718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 208/427] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:29.937956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:29.967425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf3d6f-0150-4205-ace1-7803b8d0ff39 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.033529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.049579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.050200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.050480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.050754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.145028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335c8d-99d2-413b-9078-4186f4e1a965 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.169848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.178437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.180604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.182784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.183481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.183760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.184033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.185776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.187495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.189439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 209/428] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:30.190231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.303095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 220/429] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:30.303095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.322996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579afdbf-028e-41ae-a90a-6e9157f47671 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.333983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.365378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.366384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.366797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.367229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.378916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:30.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:30.385546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:30.386333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:30.388783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 210/430] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:30.389868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.414635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecdc-627f-4a7a-bd34-60323fe1a4a9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.451753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.452393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.452923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.453619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.454556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.455544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=c9feb52043d54506826645d74efab4bd) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:30.455999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.457869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.472265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 221/431] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:30.473538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.509892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2393e3-8242-4a22-8add-2628d7e26035 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.547512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.548276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.548524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.548890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.550129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.551752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64303c48-273d-4a32-916e-a28ae9d00ac7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.554060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 211/432] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:30.560299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa889-0f73-4276-88dc-71215722e073 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.560615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa889-0f73-4276-88dc-71215722e073 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.560845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa889-0f73-4276-88dc-71215722e073 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.563421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 212/433] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:30.564239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa889-0f73-4276-88dc-71215722e073 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.605330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.615314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebafab-0d9c-484f-9291-1ae118b145bc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.653291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.653908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.654227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.654495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.655268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:30.655610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.658108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601dc9-04b5-47ae-9312-026dccf59622 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.667187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 222/434] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:30.668278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.668560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.668829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.690039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa889-0f73-4276-88dc-71215722e073 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.691789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:30.693848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:30.715383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.731944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.732593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.732873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.733141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.735214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.736689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.738587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 213/435] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:30.739414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.770439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 223/436] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:30.771097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:30.866175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9089-8e09-41ff-b67c-6602c4c1e047 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.878422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:30.897914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c551-2650-4349-8005-c6bf7d0f8df4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:30.917194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.917801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.918147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.918356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.946192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:30.947410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.947690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.947957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.948702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=2b0f7dcbac564f0cab3167129879b22f, scope.project.id=d093d451cba14c4095c1373f1f4c75d2) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:30.949275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:30.951008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42783614-eb48-41fd-b10d-bb5ff098c53f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:30.961130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 224/437] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=2b0f7dcbac564f0cab3167129879b22f => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:30.962382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec45e-ec58-4a19-9b2a-eb34f97f60a2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.962665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec45e-ec58-4a19-9b2a-eb34f97f60a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.962934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec45e-ec58-4a19-9b2a-eb34f97f60a2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.967920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 225/438] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:30.976139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9c6e-39de-4142-b446-64306f826396 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:30.976720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9c6e-39de-4142-b446-64306f826396 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:30.977194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9c6e-39de-4142-b446-64306f826396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:30.998483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.011342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-003e9c6e-39de-4142-b446-64306f826396 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:31.012677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-003e9c6e-39de-4142-b446-64306f826396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:31.016628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.018491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.102711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 226/439] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:31.103897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e9c6e-39de-4142-b446-64306f826396 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.161276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 214/440] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:31.167735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.201015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.229209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e9c6e-39de-4142-b446-64306f826396 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.269349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.269985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.270264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.270538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.270857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.283327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:31.285254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa1c3-a69d-480a-9795-61830a1650d7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:31.288800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:31.289886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:31.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:31.295229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 227/441] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:31.297507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.328788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.329542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.329819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.330089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] PATH_INFO: `/v3/projects/c9feb52043d54506826645d74efab4bd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.331361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] RBAC: Authorizing `identity:get_project(project_id=c9feb52043d54506826645d74efab4bd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.333552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.336274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 215/442] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/projects/c9feb52043d54506826645d74efab4bd => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:31.340583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.400403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2104d54-731b-46e3-ae5a-fdce5ca7340d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.434941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.435582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.435860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.436130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.436807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:31.437118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.438522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.443443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.444116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002bcf-0b61-47df-9a66-3ab9d3a3865a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.447488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 228/443] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:31.448583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.479590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.480158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.480430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.480694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.481791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.483251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.485068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 216/444] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:31.485793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.514043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.556139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274c38-69e1-436d-9f02-d29fc94b600d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.587739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce019-dfbc-4301-9d58-4b33a5591020 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.588226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.588647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.588922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.589195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.598894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:31.604022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:31.605003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 229/445] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:31.606191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.628022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.628626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.628895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.629154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.664271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.695628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.697090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.706743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af9e35-c36e-4947-98d7-2ea40a9e2490 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.722274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.741696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.742229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.742505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.742808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.743969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=c9feb52043d54506826645d74efab4bd) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:31.744277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.745720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.752331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 230/446] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=c9feb52043d54506826645d74efab4bd&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:31.753262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.804510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 217/447] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:31.810420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.868664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdab4e4-6fd4-4b96-a192-b7a552d4c299 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.893780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.910447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.911058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.911444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.911715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.912372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:31.912673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.914048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.924059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 231/448] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:31.925043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e44c-4141-4975-829d-0b8c019df6e6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:31.929960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:31.955038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:31.971071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:31.972712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:31.972990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:31.973259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] PATH_INFO: `/v3/projects/d093d451cba14c4095c1373f1f4c75d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:31.974397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=d093d451cba14c4095c1373f1f4c75d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:31.975940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:31.978127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 218/449] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/projects/d093d451cba14c4095c1373f1f4c75d2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:31.983428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:32.049844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811172-54b9-4b32-9b5a-27de656f68d0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.099969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.100714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.101060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.101404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.106913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575689-f5ba-4eec-889e-52aa5ac5a7e1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.142649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.143357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.143633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.143900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] PATH_INFO: `/v3/groups/c725f2a4d6bf4bf48f607b3def771746` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.145504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] RBAC: Authorizing `identity:get_group(group_id=c725f2a4d6bf4bf48f607b3def771746)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.146978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.148764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 219/450] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/groups/c725f2a4d6bf4bf48f607b3def771746 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:32.154917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:32.165419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:32.181464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.182966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.228908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:32.279972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c41162-8da5-4021-91e2-0a69863c5a27 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.296963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 232/451] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 05:10:32.302944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:32.314576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.315221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.315475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.315742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.316440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] RBAC: Adding query filter params (group.id=c725f2a4d6bf4bf48f607b3def771746, role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=d093d451cba14c4095c1373f1f4c75d2) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:32.316759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.318196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.324364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 220/452] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:32 2022] GET /identity/v3/role_assignments?group.id=c725f2a4d6bf4bf48f607b3def771746&scope.project.id=d093d451cba14c4095c1373f1f4c75d2&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:32.392515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:32.409209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5ea6-4dbf-4f8e-b830-f2e951c4f264 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.452648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.453284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.453925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.453925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] PATH_INFO: `/v3/projects/a9a94747b8f64b12a67048c396b7c9c0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.455780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a94747b8f64b12a67048c396b7c9c0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.456519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.458166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 233/453] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:10:32 2022] GET /identity/v3/projects/a9a94747b8f64b12a67048c396b7c9c0 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:32.464344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:32.573571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb428453-8c35-48d6-928f-748ee30c5626 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.597357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:32.609269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.609904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.610179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.610445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] PATH_INFO: `/v3/groups/d86b4b12029a41c6b86a94279b3a3c51` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.611644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] RBAC: Authorizing `identity:get_group(group_id=d86b4b12029a41c6b86a94279b3a3c51)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.613057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374755af-c319-4af7-a403-abf2710b3888 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.614621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 221/454] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Sep 2 05:10:32 2022] GET /identity/v3/groups/d86b4b12029a41c6b86a94279b3a3c51 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:32.621175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:32.722124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1061a0d-0c95-4f74-817e-a8715a55c014 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:32.758305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:32.758892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:32.759164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:32.759461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:32.760175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] RBAC: Adding query filter params (group.id=d86b4b12029a41c6b86a94279b3a3c51, role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=a9a94747b8f64b12a67048c396b7c9c0) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:32.760476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:32.761895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2b63-e3a6-4729-8914-d88c946ceaf1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:32.767928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 234/455] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Sep 2 05:10:32 2022] GET /identity/v3/role_assignments?group.id=d86b4b12029a41c6b86a94279b3a3c51&scope.project.id=a9a94747b8f64b12a67048c396b7c9c0&role.id=043be44598c24b52b429eb2a25c1962d => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:35.216637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1f583-ad9d-4380-aaa0-e43b5b940a67 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.217156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1f583-ad9d-4380-aaa0-e43b5b940a67 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.217267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1f583-ad9d-4380-aaa0-e43b5b940a67 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.218819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 222/456] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:35.224056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e862-e2aa-4fe8-9531-109a08cc6236 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.224450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e862-e2aa-4fe8-9531-109a08cc6236 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.224613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e862-e2aa-4fe8-9531-109a08cc6236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.248872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2299e862-e2aa-4fe8-9531-109a08cc6236 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:35.250164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2299e862-e2aa-4fe8-9531-109a08cc6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:35.268206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:35.290134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519947e-193b-4ded-8704-1b1807cc67b4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.290475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519947e-193b-4ded-8704-1b1807cc67b4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.290679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519947e-193b-4ded-8704-1b1807cc67b4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.292265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 223/457] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:35.297552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3c02-f867-4c9e-83f5-1d3dc14003a3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.297837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3c02-f867-4c9e-83f5-1d3dc14003a3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.298112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3c02-f867-4c9e-83f5-1d3dc14003a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.325386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5f0f3c02-f867-4c9e-83f5-1d3dc14003a3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:35.326573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f0f3c02-f867-4c9e-83f5-1d3dc14003a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:35.342912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 235/458] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:35.427437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 224/459] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:35.507909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff907-35ae-4bea-94b2-787138f7fa8c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.508263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff907-35ae-4bea-94b2-787138f7fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.508475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff907-35ae-4bea-94b2-787138f7fa8c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.509984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 236/460] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:35.519945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.520232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.520510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.542172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:35.543381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:35.639096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 225/461] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:35.747090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff907-35ae-4bea-94b2-787138f7fa8c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:35.819406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:35.885301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:35.902455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff907-35ae-4bea-94b2-787138f7fa8c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:35.951190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e21e2-91f7-4f73-9f25-b5c0bd788a7e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:35.962657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:35.963340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.963624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.963898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:35.984638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:35.986091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:35.995817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:35.996463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:35.996732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:35.996993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.010833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.012593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:36.013900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:36.014796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:36.015757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:36.015757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.015757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:36.016492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 237/462] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:36.019417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.022680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:36.035138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:36.036112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:36.037045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:36.037045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.037045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:36.037774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 226/463] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:36.039232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.128296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e896d-d1fc-4f4b-a6ba-6880fc2ee44e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.145521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2b37-fb83-4c94-8c93-66057de8bca2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.147879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.163792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.164423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.164710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.164985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.176576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.178521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.182133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.182737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.183007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.183295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.183931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:36.184226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.185599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-243aa139-c27e-4a8d-9166-9776073e4fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:36.193060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:36.193984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:36.194804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:36.194804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.194804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:36.194804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 238/464] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:36.195976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005faa-2116-4b09-a2b4-a3c61f14a704 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.195976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005faa-2116-4b09-a2b4-a3c61f14a704 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.195976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005faa-2116-4b09-a2b4-a3c61f14a704 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.197201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 239/465] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:36.197786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5005faa-2116-4b09-a2b4-a3c61f14a704 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.207318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 227/466] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:36.207318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.257460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.310385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5005faa-2116-4b09-a2b4-a3c61f14a704 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.310983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56673f-68ce-4752-9571-47ef873b37e5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.343551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.344350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.344624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.344892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.345529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:36.345827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.347233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452d701-ed67-4298-8f1e-8d97c4a4cbac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.349812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.350427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.350706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.350977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.351657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:36.351959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.353322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.359394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 240/467] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:36.360458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9d36-3801-498c-912e-726e8cf26b29 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.360776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9d36-3801-498c-912e-726e8cf26b29 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.361010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9d36-3801-498c-912e-726e8cf26b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.365811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 228/468] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:36.366616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.378961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b48c9d36-3801-498c-912e-726e8cf26b29 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:36.380124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b48c9d36-3801-498c-912e-726e8cf26b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:36.392756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.444646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 241/469] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:36.445879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a795-15d1-4a7b-9570-d9c7028c69d8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.446160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a795-15d1-4a7b-9570-d9c7028c69d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.446429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a795-15d1-4a7b-9570-d9c7028c69d8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.451846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 242/470] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:36.452623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a795-15d1-4a7b-9570-d9c7028c69d8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.474343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440043-b53f-48ca-9197-29566422bf41 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.506229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.510105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.510825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.511102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.511407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.512049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.513480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.536000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 229/471] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:36 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:36.537086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.606459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a795-15d1-4a7b-9570-d9c7028c69d8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.642514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.657236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.658344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.658889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.659378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.660406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.662236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676182c-953b-4636-8813-8aace6508d7d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.666940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e713-052b-4dca-8260-1d164e37a154 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.689322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 243/472] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:36 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:36.691035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.691529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.692063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.708206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.708832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.709104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.709367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.710028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.711605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.714434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:36.715977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:36.737657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 230/473] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:36 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:36.738550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.799075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 244/474] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:36.862312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a20c82-404c-4146-b5e1-ee9de2f7cd8e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:36.902520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:36.903098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:36.903402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:36.903689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:36.907124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:36.919567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:36.921171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:36.936977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:36.937965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:36.939293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:36.939293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:36.939293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:36.939293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 231/475] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:36.944240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:36.975810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:37.056759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198890-b53b-42a9-ab5b-0ef45b7ecd74 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:37.094512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:37.095126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:37.095447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:37.095715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:37.096424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:37.096724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:37.098083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:37.110333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 245/476] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:37.115968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:37.118428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:37.208163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:37.220924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848af98f-36da-4383-a2f2-b5fbc9f7ef49 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:37.262356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:37.262985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:37.263304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:37.263575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:37.264250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:37.265902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:37.278630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e826a-2d0e-44cd-b4eb-dead004f801a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:37.287743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.sql.core [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 05:10:37.287743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 05:10:37.287743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [parameters: {'id': 'a89cb43e80254a439af0c8ac70c046f1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 05:10:37.287743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Sep 02 05:10:37.310119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return ref.to_dict() Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:10:37.311022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application yield resource Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise self.value Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application session.commit() Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 05:10:37.312338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.flush() Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application compat.raise_( Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 05:10:37.313203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:10:37.314049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:10:37.314856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [parameters: {'id': 'a89cb43e80254a439af0c8ac70c046f1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:37.315650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 05:10:37.316433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.319672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 246/477] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Sep 2 05:10:37 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:37.327299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:37.335102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:37.336729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:37.337016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:37.337288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:37.337969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:37.339488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:37.389973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 232/478] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:37 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:10:37.440876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147a325-9363-4beb-a9b4-2210e97d5a2b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:37.477935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:37.478582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:37.478858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:37.479129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:37.490998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9a725808-9340-49f6-9347-db340bef95f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:37.496770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:37.497886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 05:10:37.498899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:37.499978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 247/479] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:10:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:37.504365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:37.577853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:37.639523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa078-7413-4b1a-b373-3fbd8dc94b48 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:37.677263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:37.678234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:37.678711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:37.679286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:37.680151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:37.680667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:37.682251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7fc63-ad12-4fd0-b6d7-da49807d0233 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:37.692129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 233/480] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:38.877067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5991-233f-42de-9195-6fa43ebda325 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:38.878036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5991-233f-42de-9195-6fa43ebda325 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:38.878534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5991-233f-42de-9195-6fa43ebda325 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:38.880347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 248/481] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:38.886012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770b2-e041-435b-9c34-153dfb5b6e70 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:38.886436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770b2-e041-435b-9c34-153dfb5b6e70 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:38.886625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770b2-e041-435b-9c34-153dfb5b6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:38.916217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-941770b2-e041-435b-9c34-153dfb5b6e70 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:38.917416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-941770b2-e041-435b-9c34-153dfb5b6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:38.997832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 234/482] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:39.209314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bd87-0aa6-4072-893b-ae2e3259cf4a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.209498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bd87-0aa6-4072-893b-ae2e3259cf4a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.209889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bd87-0aa6-4072-893b-ae2e3259cf4a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.211389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 249/483] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:39.216711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f871a4-d6f4-4ecd-8931-b6e578e29da5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.216990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f871a4-d6f4-4ecd-8931-b6e578e29da5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.217255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f871a4-d6f4-4ecd-8931-b6e578e29da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.240139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c1f871a4-d6f4-4ecd-8931-b6e578e29da5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:39.241325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1f871a4-d6f4-4ecd-8931-b6e578e29da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:39.272325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:39.314648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 235/484] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:39.370646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa98c88-ea51-4a88-a7f6-5bd4e82fe7c0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.371076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa98c88-ea51-4a88-a7f6-5bd4e82fe7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.371505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa98c88-ea51-4a88-a7f6-5bd4e82fe7c0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.373206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 250/485] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:39.378217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.378657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.379069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.397870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:39.398046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa98c88-ea51-4a88-a7f6-5bd4e82fe7c0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:39.399496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:39.423451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:39.477509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 236/486] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:39.595938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa98c88-ea51-4a88-a7f6-5bd4e82fe7c0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:39.639774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:39.640412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.640690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.640962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.643527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:39.652840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:39.657970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:39.658864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:39.659694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:39.663517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 251/487] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:39.665032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:39.793245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:39.800130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:39.807743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d223-0fa9-4724-969c-141b9622711c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:39.830080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660d9e-555e-4e24-9a00-f42e4d566709 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:39.845879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843152cc-df88-44fd-9221-485605f47924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:39.846517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843152cc-df88-44fd-9221-485605f47924 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.846887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843152cc-df88-44fd-9221-485605f47924 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.847154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843152cc-df88-44fd-9221-485605f47924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.858601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843152cc-df88-44fd-9221-485605f47924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-843152cc-df88-44fd-9221-485605f47924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:39.863635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:39.865682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:39.867607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:39.869464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:39.869464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:39.869774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 237/488] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:39.869908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:39.869908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:39.870173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843152cc-df88-44fd-9221-485605f47924 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:39.870320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:39.870320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:39.870320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:39.887393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 252/489] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:39.889331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:39.983247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843152cc-df88-44fd-9221-485605f47924 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:39.997648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa49b-4baa-45f1-b47f-a40b430d0a5c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.021141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.021957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.022299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.022710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.033449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.033716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:40.034061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.034380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.034648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.035381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:40.035685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.037047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.038449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:40.040311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.041565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:40.042336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:40.045014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 238/490] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.046115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.049341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 253/491] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:40.056302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.072926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.162172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a709-6a09-474d-826c-77bb7484c23f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.163694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05515345-e630-44b4-aabe-ec45763187f4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.196228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.196850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.197124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.197388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.199280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.200182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.200634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.201064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.201932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:40.202433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.204137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.207510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.208944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.217647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 254/492] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:40.218755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-959de59f-84d1-4d0d-820e-7acabc507d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:40.224669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.225616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:40.226559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:40.226559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.226559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:40.230290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 239/493] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.231517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c122e9-953e-4f7a-b605-f2dfdee730a5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.231818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c122e9-953e-4f7a-b605-f2dfdee730a5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.232086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c122e9-953e-4f7a-b605-f2dfdee730a5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.233325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 240/494] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:40.234248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c122e9-953e-4f7a-b605-f2dfdee730a5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.285623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.307316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.332993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cec5-6381-48bb-88e0-93fb64d23f21 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.347021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c122e9-953e-4f7a-b605-f2dfdee730a5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.366479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.367122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.367419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.367688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.378569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.380031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.384476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.385290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.385624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.385952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:40.396247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.397346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:40.398178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:40.398178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.398178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:40.398338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.398406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 255/495] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.398479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.398546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-823f0e6a-1b12-4a40-99c9-8d2160ae8662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:40.412898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.414010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:40.415003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:40.415003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:40.415003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:40.415003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 241/496] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.415316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0786745-fcb8-4fc4-aa22-3b127300f865 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.415393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0786745-fcb8-4fc4-aa22-3b127300f865 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.415615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0786745-fcb8-4fc4-aa22-3b127300f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.433829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d0786745-fcb8-4fc4-aa22-3b127300f865 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:40.435000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d0786745-fcb8-4fc4-aa22-3b127300f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:40.501721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 242/497] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:40.502219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ada8bf-4333-481e-85cb-d363e9870cf8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.502972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690f79f-62d8-47c5-a16c-068007ae6c19 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.503310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690f79f-62d8-47c5-a16c-068007ae6c19 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.503588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690f79f-62d8-47c5-a16c-068007ae6c19 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.504827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 243/498] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:40.505516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690f79f-62d8-47c5-a16c-068007ae6c19 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.524746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.553663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.554291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.554938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.555233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.556157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:40.556464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.557919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.558299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.573796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 256/499] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:40.574812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.609785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690f79f-62d8-47c5-a16c-068007ae6c19 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.648047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.648736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.649013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.649301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.649937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:40.650227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.651640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0201-99a0-4067-9320-14e29adbc485 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.663601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 244/500] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:40.664767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.665042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.665307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.685211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:40.686376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:40.694952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e949bd-ea34-4d43-87f2-bc662c152966 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.730145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.730774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.731044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.731552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.731974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:40.732271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.733886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.750065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 257/501] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:40.750065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.763807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 245/502] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:40.768156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.788168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.812673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:40.864732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994384f-034a-433c-ada9-29b422016aa4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.874769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1d0d-8d76-41c1-a0e8-e10846655057 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:40.900909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.901675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.902089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.902479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.910194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.910951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:40.911614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:40.911733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.911886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:40.912153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:40.919483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:40.920933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:40.925342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.926256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:40.927143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 258/503] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.928332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:40.939538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:40.940606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:40.941688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:40.943544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 246/504] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:40.944396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.030010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.040188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ffca-581f-40db-9a54-3563dc457288 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.047916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.050574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd982d-9fe6-4a62-afcb-d33ab9ea7d16 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.075574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.076132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.076403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.076666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.083918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.084260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.084887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.085158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.085345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.085433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.095774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:41.096453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:41.097479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 259/505] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:41.098365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:41.101156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:41.102064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 247/506] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:41.102883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.199278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db773-df3e-426e-bcf1-bf85931b264b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.201298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4d00-de42-4ee1-9ca8-eac9422d5426 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.231933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.232534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.232808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.233075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.233927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:41.234225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.235681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.236517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.237131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.237409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.237685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.238406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:41.238707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.240185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.272652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 260/507] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:41.273630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.281034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 248/508] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:41.281842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.288214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.302028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.377133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b58-5b98-4336-bc8f-9851a8117af1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.387063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e9ba-3b3d-4993-baba-890bb31b8d5a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.410643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.411296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.411569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.411850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.421617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.422484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.423095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.423228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.423405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.423679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.424404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:41.424713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.426168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:41.437443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:41.438488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:41.439366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:41.439366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:41.439366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:41.439366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 261/509] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:41.439366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.446603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 249/510] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:41.447451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.503214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.532678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.545478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8491-7ade-40f3-aff1-90b31c1a55c4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.556112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f795-73b7-4c8e-abd1-ed96b741cd8b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.579700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.580310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.580588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.580861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.581528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:41.581826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.583258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.589470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.590071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.590348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.590614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.595860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 262/511] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:41.595860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.664382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.665787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.689015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fe221-99a8-4771-9683-2394e3d72e7e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.710642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.722880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.723520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.723796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.724067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.741047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.766516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 250/512] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:41.767441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.791121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.792600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.870012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5220-9130-4986-a578-bfe1728d812f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:41.894455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 263/513] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:41.895304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.905570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:41.906180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:41.906452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:41.906710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:41.907378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:41.907669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:41.909059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:41.920045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:41.920653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 251/514] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:41.921705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:41.956746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.004337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5f0a1-06e0-4dfc-8585-a66add30303f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.029816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45509-6566-4e4e-a82e-afa6c4b7cbfc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.037479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.038079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.038350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.038614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.064111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.064721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.064994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.065257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.074983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.076468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:42.090938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:42.091847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:42.092695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:42.092695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.092695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:42.092695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 252/515] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:42.093239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.106905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.108544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.131700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.181869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.194084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c5cc-8fa3-4814-acef-88865a44dcbb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.207807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 264/516] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:42.208623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.228219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.228854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.229121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.229402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.239897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.241355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:42.255498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:42.256401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:42.257221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:42.257221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.257221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:42.257221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 253/517] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:42.257651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.312403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105a79-050e-40ec-a44d-35a1e296d224 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.334983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.346842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.347595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.347843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.348110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.357689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36d23b-2bc8-4ec3-9fe2-35d32476b6fc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.357948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.359430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:42.373619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:42.374618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:42.375480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:42.375480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.375480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:42.375480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 265/518] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:42.375711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.394772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.395437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.395714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.395982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.396623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.398065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.409147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.423349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 254/519] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:10:42 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:10:42.424618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.490123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90517a6-d5f1-451c-a786-8adda6d38748 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.527461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.528073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.528350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.528613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.529260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:42.529559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.531005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.548041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 266/520] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:42.548266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594622-f808-400b-b311-5559d80e6c6b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.548362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.582160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.589335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.590314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.590593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.590856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.604333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.606219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:42.622914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:42.623859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:42.624907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:42.624907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:42.624907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:42.624907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 255/521] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:42.625552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.663417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaff94-a204-401d-a9ac-3350b8bd58c0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.679982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.698196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.699047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.699357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.699634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.700279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:42.700585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.701955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.718030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 267/522] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:42.718030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.742952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577906f6-8f99-40c6-b46e-f833d1dd9c00 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.779044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.779680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.779949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.780513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.781167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:42.781462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.782840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.799879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 256/523] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:42.799879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.831987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.840520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c07a-35f3-4ed9-8edf-e429553be921 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.879793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.880810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.881299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.881790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.890347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.892104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:42.903844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:42.904786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:42.905872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:42.907670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 268/524] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:42.908609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:42.915464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89175f0-ef59-4a86-8d8c-ade7d09a9633 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:42.928414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:42.958787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:42.959446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:42.959702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:42.959978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:42.960619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:42.960923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:42.962309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:42.974371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 257/525] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:42.975090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.021197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203291e-c9d9-40ec-9462-e3b925710ee6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.054777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.055438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.055715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.055955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.062928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.064416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:43.076184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:43.077127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:43.077959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 269/526] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:43.078451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.088745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00aaf-a800-4dd9-bd7e-f4bd836fdc42 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.098309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.128015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.129035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.129331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.129647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.138157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.139900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:43.152608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:43.153607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.154745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:43.158565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 258/527] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:43.159423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.188446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.209369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78e4b4-0d45-4654-a3be-3acd84374309 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.247008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.247571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.247847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.248116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.249005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.249385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.250930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.264869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320aedc-a728-4626-a58c-e1e440a37cc7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.274206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 270/528] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.274206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.301333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.302057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.302335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.302605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.309220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.310695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:43.322751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:43.323872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:43.324939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:43.325867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 259/529] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:43.331258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.355233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.386005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959773-dbcb-4f54-a18d-78dd1e5e9f80 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.421817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.422507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.422790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.423060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.424327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.425217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.425570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.427476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.437722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d98da-6ac9-428d-a01b-ea76dc694b28 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.446585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 271/530] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.451496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.482389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.483003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.483496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.483617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.484514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.484969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.486398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.506602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 260/531] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.507410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.559439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d177c2-1052-4967-987c-fe0d86f0d1c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.589583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.596783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.597406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.597691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.597966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.617283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7ffd-627b-4394-bf7d-185044f1471e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.653239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.653846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.654120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.654385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.655068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.655438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.656942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.673445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 261/532] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.673445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.676469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.677926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.682282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.778478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc8dc-8152-42d4-aac9-473d5bc7e86d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.779398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 272/533] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:43.780299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.810211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.823944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.824555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.824832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.825155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.825830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.826147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.827714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.843243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 262/534] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.843243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.900733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3694-7cb3-4f50-841b-45e62a3891bf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:43.931930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:43.950881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:43.951681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:43.952066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:43.952954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:43.953794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=d812f7fb4e114ae4ab5d7c2a111df3a1) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:43.954330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:43.956122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:43.965008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 273/535] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/role_assignments?user.id=d812f7fb4e114ae4ab5d7c2a111df3a1&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:43.965702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:43.972325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd455-672e-4c9a-bcec-25a0cad6f590 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.030379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.031383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.031836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.033621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.034677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=c891710c74ca4a4dae183c7979152109) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:44.035169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:44.036898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:44.054694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 263/536] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/role_assignments?user.id=c891710c74ca4a4dae183c7979152109&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:44.088999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:44.100080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9e40-2788-41b5-a30d-7e9555accb9d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.139525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.140194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.140476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.140753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.153821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:44.155387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:44.171857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:44.172823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:44.173644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:44.173644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:44.173644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:44.173644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 274/537] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:44.179192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:44.292790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da99e35-2552-41bf-98ce-81ba7c68f944 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.328936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.329557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.329830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.330101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.330750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:44.331051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:44.332476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b8b57-b730-4404-9ba6-4e7f0f846ba9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:44.335022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:44.352438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 264/538] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:44.358077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:44.369734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7354-c87a-4c9a-bebd-86496f5a4be9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.370030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7354-c87a-4c9a-bebd-86496f5a4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.370284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7354-c87a-4c9a-bebd-86496f5a4be9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.372593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 265/539] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:44.380419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.380705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.380977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.412411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:44.415370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:44.541917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90ba1-f10d-46d5-88f0-889b5780975a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.552756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 266/540] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:44.597288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.598317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.598800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.599289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.610121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:44.611607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:44.623754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:44.624962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:44.626169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 275/541] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:44.631026 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:44.768356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0f22-0ecf-4e5f-b390-2f7278402635 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.803268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:44.816489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.817451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.817914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.818366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:44.819297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:44.819873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:44.821532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:44.838772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 267/542] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:44.844701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:44.858161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:44.950011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:44.971223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360ead-5eb4-4bab-9176-28dfc9075b17 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:44.998365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:44.999070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:44.999451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:44.999770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:45.000456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=bf8d5b7a906244a9997fcabc92b00e04) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:45.000767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:45.002223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:45.008077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 276/543] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:44 2022] GET /identity/v3/role_assignments?user.id=bf8d5b7a906244a9997fcabc92b00e04&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:45.135514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fa626-5202-4c38-ab84-9315221ff86c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:45.172418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:45.173075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:45.173345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:45.173609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:45.185717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:45.190955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:45.191831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:45.192619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 268/544] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:45.199690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:45.299564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:45.340692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbac01-2b09-4a2b-93ed-5a5866e4599b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:45.375406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:45.376027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:45.376308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:45.376581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:45.377244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:45.377546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:45.378921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:45.387829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 277/545] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:45.393470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:45.473203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:45.549244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34061-fad0-4d53-b674-f8f0d9f513b3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:45.598331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:45.598974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:45.599271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:45.599541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:45.610894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:45.612389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:45.627464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:45.628360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:45.629152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:45.629152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:45.629152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:45.629152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 269/546] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:45.634375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:45.764310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff07a-0113-4616-aebc-3c5eddb395d1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:45.799014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:45.799659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:45.799938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:45.800209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:45.800858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:45.801160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:45.802531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a76b4-a45c-4fb4-8f3a-c74977f5c19c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:45.804091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:45.814984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 278/547] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:45.823213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:45.986034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:45.991506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159e173-0b18-4ddf-889e-65ce2ae09377 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:46.027519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:46.028080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.028362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.028631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.037046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:46.038505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:46.050524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:46.052582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:46.054702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 270/548] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:46.055434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904e3d-1ec7-4119-a542-b53427f44161 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.055434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904e3d-1ec7-4119-a542-b53427f44161 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.055582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904e3d-1ec7-4119-a542-b53427f44161 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.063236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:46.063406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 279/549] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:46.063616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.063905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.064183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.101301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:46.103894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:46.233600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a99c-52e3-434b-8d45-95af8d10f4cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:46.271793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:46.272409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.272680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.272950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.273671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:46.273964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:46.275514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb0ee6-24ad-4bb1-a140-77e614c44c24 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:46.285436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 280/550] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:46.294770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 271/551] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:10:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:46.300084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:46.417344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7a99-f04a-401d-aafc-37626dfe4956 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.417671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7a99-f04a-401d-aafc-37626dfe4956 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.418144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7a99-f04a-401d-aafc-37626dfe4956 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.420165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 272/552] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:46.425077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36397e-05e8-40ef-a42d-e77386a8c7bc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.425357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36397e-05e8-40ef-a42d-e77386a8c7bc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.425637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36397e-05e8-40ef-a42d-e77386a8c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.444546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1d36397e-05e8-40ef-a42d-e77386a8c7bc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:46.445763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1d36397e-05e8-40ef-a42d-e77386a8c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:46.452455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de4696-63ae-42f3-a59b-bc058c13d510 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:46.466833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:46.499523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:46.540190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:46.540787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.541079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.541356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.558314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 273/553] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:46.559949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8effb5-4dec-48d6-a718-34e059a64074 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.560457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8effb5-4dec-48d6-a718-34e059a64074 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.560973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8effb5-4dec-48d6-a718-34e059a64074 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.562778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 274/554] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:46.568064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.568546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.569048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.588103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:46.589739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:46.646982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:46.648474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:46.662490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 275/555] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:46.670183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:46.753602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 281/556] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:46.760166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:46.785491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:46.807011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:46.814863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cb2a-35f7-4288-b8ca-cb301935d1e1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:46.853358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:46.854450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.854961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.855445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.866829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:46.872439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:46.873331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:46.874265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:46.876994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 276/557] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:46.878060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:46.912109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f167e-ba7e-4c65-818d-61b11c510f8b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:46.963668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596612a-27cf-47a5-8981-31633974373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:46.964305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596612a-27cf-47a5-8981-31633974373d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:46.964579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596612a-27cf-47a5-8981-31633974373d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:46.964844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596612a-27cf-47a5-8981-31633974373d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:46.980375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596612a-27cf-47a5-8981-31633974373d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:46.982847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596612a-27cf-47a5-8981-31633974373d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a596612a-27cf-47a5-8981-31633974373d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:47.003467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.004402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:47.005237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:47.005237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.005237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:47.005397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b355762-794e-43bd-91e9-1e608fe1a1c4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.008584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 282/558] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.009663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596612a-27cf-47a5-8981-31633974373d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.042763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.043408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.043690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.043993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.047428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.056530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:47.061357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.064248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 277/559] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.065080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.105271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.132676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596612a-27cf-47a5-8981-31633974373d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.166409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01eb98-ad51-43bc-b519-bd62d97e2c5b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.169342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.169342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.169568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.169789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.170425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.170922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.172186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.184883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 283/560] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.184883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.208628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.209350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.209624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.209893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.210539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.210837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.212321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.228889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 278/561] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.228889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.286997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.295169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e8a8-d374-4bc6-bb12-f97b726cc65f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.330612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.331169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.331478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.331748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.335311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab40b-2fea-42fe-9c9d-305eb725c399 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.338512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.343648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:47.349011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.349953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:47.350769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:47.353529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 284/562] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.360397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.372916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.373902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.374193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.374675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.375396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.375704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.377101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.385947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 279/563] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.388062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.466885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970d8f-22f5-454a-b6bc-70918d60c063 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.489097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170a0d-be39-478a-9ce3-ac1df58fed59 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.502204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.502841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.503116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.503411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.505856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.514165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.515683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.522877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.523539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.523818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.524087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:47.529371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.530623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:47.532201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:47.532201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.532201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:47.532201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 285/564] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.532435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.532508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.532575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:47.545308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.546677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 280/565] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.548090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.583526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.633926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ac5a2-e0e6-4962-8161-420a8fdb5029 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.649114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bb1e2-1ef8-4f88-b810-bb17400798f2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.667952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.668556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.668835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.669133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.669790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.670092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.671729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220319-977c-4855-bc30-f9f0b9a76874 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.679748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 286/566] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.680898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636e88-5951-4398-b713-26e1714ed000 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.681183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636e88-5951-4398-b713-26e1714ed000 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.681456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25636e88-5951-4398-b713-26e1714ed000 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.682813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 287/567] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:47.683352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636e88-5951-4398-b713-26e1714ed000 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.684363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.685242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.685522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.685851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.697934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.699432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:47.713864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:47.714809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:47.715723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:47.715723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:47.715723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:47.715723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 281/568] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:47.715723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.746602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.792527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25636e88-5951-4398-b713-26e1714ed000 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.805659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.819833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac37c5c-8453-4f74-8dde-eb3a3670f6f7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.827019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.827911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.828190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.828459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.829083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.829380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.830741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.847102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 288/569] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.847102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.859920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.860546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.860840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.861103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.861800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:47.862080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:47.863563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b896e2e-dc5b-415f-acb1-4a911fb1db0e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:47.876953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 282/570] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:47.878138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.878422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.878694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:47.898097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:47.899333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:47.954776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece3ce4-196c-427c-a36d-43ca821aaede None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:47.971930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 283/571] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:47.971930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:47.990027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:47.995555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:47.996311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:47.996593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:47.996859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.007441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.008894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:48.023940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.025121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:48.026428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:48.026428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:48.026428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:48.026428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 289/572] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.026428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.053360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.083647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a589-c453-4742-aaa9-3967cf620db8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.125235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.125776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.126055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.126325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.126966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.127295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.128697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.133169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1ec6-ac05-4a07-9a80-680e04ac83c8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.141266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 284/573] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.142072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.171888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.172514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.172791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.173061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.180558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.181995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:48.193359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.194329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 290/574] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.195284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.232061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.251738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf68be-8905-45e7-966b-04e428e5790e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.278792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.285534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.286139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.286416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.286685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.287449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8c7c13d179cf442999070e1e0d1cf89b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.288014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.289187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.294583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 285/575] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/role_assignments?user.id=8c7c13d179cf442999070e1e0d1cf89b&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.295427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.296893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baee4e8-6c6e-4f4b-84c7-84be0ac7c685 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.334303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.334926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.335222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.335489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.336283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.336445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.337873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.355686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 291/576] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.355686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.419488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00372a-2e8a-4d42-a977-d736278823dc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.458312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.459093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.459450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.462721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.468030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b5be6-00e8-4aa5-9f3f-2620d191b6af None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.472936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.474404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:48.486769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.487778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:48.488687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 286/577] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.489262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.494579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.509269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.509876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.510149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.510447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.511139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.511558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.512868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.534881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 292/578] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.535874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.538816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.600570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cfcf-1b83-459c-8b2d-9169534061b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.635871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.636503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.636781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.637046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.641125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e723-4d04-4736-b0be-80f6ff2939c9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.648050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:48.653300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.654395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:48.655444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:48.659344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 287/579] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.660204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.681429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.682361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.682897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.683390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.691643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.693395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:48.706249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.707647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:48.708579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 293/580] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.709463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.727396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.769674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921a972-ed71-47bd-abdc-ed36076375e5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.775510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.805278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.805888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.806160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.806426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.807143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.807466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.808911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.818183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a56e5-fcc2-46df-b4f0-01d714b6d6e0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.825970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 288/581] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.827069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.858603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.859334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.859619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.859864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.870875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.872357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:48.887734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:48.888890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:48.890524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:48.890524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:48.890524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:48.893827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 294/582] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:48.894688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:48.940822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dde2-c5a5-454f-91d1-c33c18a2bb43 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:48.966083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:48.979378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238130-3134-4b87-845c-93e9848f602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:48.979987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238130-3134-4b87-845c-93e9848f602b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:48.980260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238130-3134-4b87-845c-93e9848f602b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:48.980526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238130-3134-4b87-845c-93e9848f602b None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:48.981185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23238130-3134-4b87-845c-93e9848f602b None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:48.981480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23238130-3134-4b87-845c-93e9848f602b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:48.982845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23238130-3134-4b87-845c-93e9848f602b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:48.991471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 289/583] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:48.992246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238130-3134-4b87-845c-93e9848f602b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.015223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a873-86bd-48ad-a044-da1632b980f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.029075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.051819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.052419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.052678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.052944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.053667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.053966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.055441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.072925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 295/584] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.073809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.103646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238130-3134-4b87-845c-93e9848f602b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.138653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.139368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.139695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.139968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.150925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.152422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:49.167084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:49.168217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:49.169267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:49.169267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.169267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:49.170637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 290/585] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:49.171645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.187856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f9b3-c5ab-4bff-afc4-bd2d9c76a242 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.208805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.225455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.226066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.226341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.226607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.227267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.227978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.229609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.247544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 296/586] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.248414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.279015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1d80-682d-4db0-b5f1-00db66d547b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.280158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.315742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.316437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.316643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.316909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.327864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.329321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:49.344967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:49.345992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:49.346846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:49.346846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.346846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:49.346846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 291/587] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:49.347074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.362278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce15d6-1a67-47db-8457-7ac1802b1114 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.400635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.401272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.401545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.401813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.412688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.414116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:49.428502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:49.429728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:49.430774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:49.430774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:49.430774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:49.430774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 297/588] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:49.430774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.446336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.461324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339dd0-a623-4bf8-be16-58d64888d8f1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.497718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.498319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.498592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.498990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.499667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.499961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.501338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.518046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 292/589] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.518046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.532074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.549660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68598f84-da51-4bdc-ab64-fdec79d5f40e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.582987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.583663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.583942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.584212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.591044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.592788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:49.604106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:49.605013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:49.605885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 298/590] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:49.607299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.629705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6c552-ec64-452a-8781-83256b23bc89 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.667205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.667825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.668138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.668359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.669016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.669534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.670750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.682993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 293/591] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.683839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.695231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.713658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310a2a-6054-4134-be8a-fda9ffb08552 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.750199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.750813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.751094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.751405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.752051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.752352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.753867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.765959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 299/592] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.766781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.774650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.798029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df5b0-046d-49db-aadb-a932e83f9132 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.834826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.835649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.836017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.836375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.844261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.845791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:49.857892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:49.858852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:49.859784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:49.863820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 294/593] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:49.864482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.875017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ff42-feb5-4910-b1c3-c0d3f37b1fea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:49.913509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:49.914406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:49.914754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:49.915084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:49.915855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:49.916211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:49.917696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:49.930046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 300/594] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:49.930941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:49.936613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:49.975308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad735-23e9-42fe-b7d9-f1973040a32c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.005305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.008636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.009355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.009696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.010033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.018347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.019903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:50.030853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:50.032015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:50.033140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:50.033648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 295/595] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:50.034230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.054285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91086e8-dbd6-454f-ab30-7520b4d3df03 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.089119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.089907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.090277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.090681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.097727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.099159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:50.110478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:50.111458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 301/596] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:50.117381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.144704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd17b-b6cf-4b22-83d9-00a12ab3f738 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.173518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.182373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.182980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.183286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.183555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.184244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:50.184546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.185974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.198093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 296/597] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:50.198946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.217703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8413e9-6b48-4093-87b8-303ca2419afc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.241231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.253942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.254607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.254890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.255164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.270001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=5fde80d2e5cd4553b1b282284825d3d6, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.271477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.285297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 302/598] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:50 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:50.286249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.300052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0904dce-9f6f-48ec-8aee-ea9624ab9c30 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.338368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.339834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.340331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.340606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.341392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:50.341693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.343506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935051-81d1-499b-a447-327c34dc7f0a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.364400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 297/599] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:50.366076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024c9a-75f1-4bff-90d2-fa46d3c0d591 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.366574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024c9a-75f1-4bff-90d2-fa46d3c0d591 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.367034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024c9a-75f1-4bff-90d2-fa46d3c0d591 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.369175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 298/600] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:50.370399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9024c9a-75f1-4bff-90d2-fa46d3c0d591 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.423454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd774349-1bb9-46cb-9e71-de395de31893 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.430378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.471190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.471841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.472127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.472402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.473312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:50.473428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.474831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.487523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 303/601] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:50.488178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.495631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9024c9a-75f1-4bff-90d2-fa46d3c0d591 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.524075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.531942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.532614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.532879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.533143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/c891710c74ca4a4dae183c7979152109/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.548771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=c891710c74ca4a4dae183c7979152109, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.550223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f41f1-2a3c-46cb-bf4a-4b337f4d1331 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.565843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 299/602] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:50 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/c891710c74ca4a4dae183c7979152109/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:50.567328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.567611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.567879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.595085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:50.597563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:50.611906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe4d9-a1dc-4cce-9758-f7d7ec5b86f3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.660295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.661312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.661835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.662339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.680179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.683178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.694356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 300/603] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:50.699959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:50.704596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:50.705528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:50.706391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:50.706391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:50.706391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:50.712203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 304/604] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:50.715762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.747679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.809453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:50.825699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb22cb8-bbf1-45b6-8a2a-e9fabc4b776f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.826532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94fe1f-a663-460c-8388-d0d8f4aeae43 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:50.861476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.862353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.862788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.863254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.864006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:50.864108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:50.864472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.865036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:50.865457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:50.865866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/d812f7fb4e114ae4ab5d7c2a111df3a1/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:50.866202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.885254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=d812f7fb4e114ae4ab5d7c2a111df3a1, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:50.887402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:50.890594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 305/605] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:50.892407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:50.904480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 301/606] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:50 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/d812f7fb4e114ae4ab5d7c2a111df3a1/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:51.064758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20682-0826-44af-82a4-72cac69096c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.106542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.107452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.107870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.108354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.117486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:51.119478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:51.131016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:51.132167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:51.133263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:51.135285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 306/607] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:51.144187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:51.173122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:51.182471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:51.260738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:51.296163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb6cf-d2e6-4658-aa3f-80a40a1bc193 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.334960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640642-b37f-4cf3-9136-0bb6f6c8ba47 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.359529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.360173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.360389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.360658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.361352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:51.361648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:51.363080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:51.382012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 302/608] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:51.391924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:51.407131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.408774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.409298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.409766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.422100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:51.428556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:51.429909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:51.430719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:51.437859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 307/609] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:51.440061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:51.522189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:51.596632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553782a-2f64-483e-b380-dcb262df9f10 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.599689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9da5-de0c-40c5-a927-89851be6fd88 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.663682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.665522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.666296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.667459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.668592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:51.669773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:51.670653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.672289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:51.673167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.673658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.674120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/bf8d5b7a906244a9997fcabc92b00e04/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.682685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:51.692942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 308/610] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:51.698361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:51.707152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=bf8d5b7a906244a9997fcabc92b00e04, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:51.712373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:51.747055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 303/611] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:51 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/bf8d5b7a906244a9997fcabc92b00e04/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:51.871590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a843-3ceb-4b36-8737-9451e2ca441b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:51.910525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:51.921216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:51.921869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:51.922955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:51.922955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:51.934116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:51.935645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:51.951606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:51.952598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:51.953971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:51.953971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:51.953971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:51.953971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 309/612] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:51.959019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.067925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2915ad-c8a0-45b4-8e69-bd7a1c4d3077 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:52.114914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:52.115551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.115868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.116139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.116827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:52.117122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:52.118807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45432e49-9066-4662-b72b-73dbac86c4f4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:52.134067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 304/613] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:52.139279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.242725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cd3a-768a-47c3-b78e-541ea7a1a468 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.243380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cd3a-768a-47c3-b78e-541ea7a1a468 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.243612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3cd3a-768a-47c3-b78e-541ea7a1a468 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.245188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 305/614] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:10:52.250139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.250416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.250685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.258906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9750f0-1d52-4926-83da-16017aee2566 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:52.269192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:52.270370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:52.327605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:52.327977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:52.328620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.328895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.329160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.342028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:52.343561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:52.363752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:52.364749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:52.365662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:52.366556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 310/615] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:52.372321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.380189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 306/616] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:52.435710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:52.505051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293197a8-8b75-471b-afcd-3c10c3ff5967 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:52.539026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:52.540071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.540533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.540972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.541908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:52.542390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:52.544090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6f26f-bcd3-4933-a47a-5e0cf1d35a12 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:52.568164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 311/617] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:52.573580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.703895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78d93a-f70d-4ff7-a9a0-540d3eece562 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:52.756000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:52.756640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.756911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.757174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.772333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:52.773782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:52.795072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:52.796160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:52.797012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:52.797012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:52.797012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:52.797595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 307/618] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:52.801319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50dc-8b31-4859-be5f-87d25f8edc86 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.801567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.801700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50dc-8b31-4859-be5f-87d25f8edc86 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.801877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d50dc-8b31-4859-be5f-87d25f8edc86 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.803688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 312/619] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:52.808571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.808858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.809133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.828221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:52.829801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:52.835409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:52.908500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbbde-ae7a-444b-a399-510ff949d81f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:52.916744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 313/620] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:10:52.923640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.943783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:52.944441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:52.944714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:52.945026 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:52.945664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:52.945956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:52.947408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:52.960412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 308/621] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:10:52.965442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:52.972922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.045402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e7c9b-0aef-436d-9d61-a36b39c812c5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.072450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d16af-c822-4527-b8c2-c1b37dc1617b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.075688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.097347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.097995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.098268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.098531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.109957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.110928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.111495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.111958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.120136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.120925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:53.122091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:53.133149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:53.134129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:53.134966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 314/622] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:53.141726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:53.142601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:53.143493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:53.144420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.146046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 309/623] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:53.151598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.286589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.312627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ff7eb-3815-49ca-891e-033209b7f921 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.338220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e077b-c6be-49e7-b15f-67f43f69149a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.346734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.347187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.347485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.347750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.348415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:53.348710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.350067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.358694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 315/624] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:53.363324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.383294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.384615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.385150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.385605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.386535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:53.387110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.388933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.402673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 310/625] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:53.403848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.415812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.465939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dccd-5640-44ba-9bf3-1a209caf4b35 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.498849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.499667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.499959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.500227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.510512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:53.516143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:53.517224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 316/626] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:53.518515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.531661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838d6-47bb-45ef-a079-63da53a2e344 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.531833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.567549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.568217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.568492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.568765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.581599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.583551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-917bc023-a7d3-4a45-95f3-14afb6134131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:53.598147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:53.599233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:53.600120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:53.600120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:53.600120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:53.600120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 311/627] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:53.600859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd13d0-0071-4bf6-8446-1525a46d7f72 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.600859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd13d0-0071-4bf6-8446-1525a46d7f72 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.601101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd13d0-0071-4bf6-8446-1525a46d7f72 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.602440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 312/628] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:53.607259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd13d0-0071-4bf6-8446-1525a46d7f72 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.632421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb9e3-d140-4d99-8d96-36ffe894d65d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.669911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.670621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.671006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.671313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/8c7c13d179cf442999070e1e0d1cf89b/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.671758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.686601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=8c7c13d179cf442999070e1e0d1cf89b, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.688194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.711235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 317/629] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:10:53 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/8c7c13d179cf442999070e1e0d1cf89b/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:10:53.711235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.728115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd13d0-0071-4bf6-8446-1525a46d7f72 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.778198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.778933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.779342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.779678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.781359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:53.781771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.783377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82ad8c-5b8e-42d8-bdea-49849a17d616 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.792676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:53.793910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 313/630] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:53.795266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.795632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.796629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.819162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:53.820420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:53.847654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f801-6b48-44ea-9017-99cb64ab0ac9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:53.893893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:53.894521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:53.894798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:53.895071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:53.895815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:53.896119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:53.897489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:53.906792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 314/631] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:53.907692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.918651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 318/632] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:53.924281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:53.971138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.024590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222566f5-fe6c-4ee2-b30f-e30a9fce66a1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.028979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409806d1-e732-43d9-b8de-84b1d12574be None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.049174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.063496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.064389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.064755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.065136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.066949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.068431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.068901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.069365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.074621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.076588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.082520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.084283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3a39647b-7c0b-44ef-a764-25bb1461bf46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:54.088866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:54.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:54.090725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 319/633] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:54.096289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8581b-4020-41e0-87f2-09e472481fc4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.096633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8581b-4020-41e0-87f2-09e472481fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.096973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8581b-4020-41e0-87f2-09e472481fc4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.098568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 320/634] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:54.099385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8581b-4020-41e0-87f2-09e472481fc4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fe58a817-04ff-499f-9146-a34f0ad044ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:54.100281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:54.101198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:54.102080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:54.102080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:54.102080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:54.102080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 315/635] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:54.109273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.109728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.110133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.130443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:54.132008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:54.209951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 316/636] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:54.210947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.222404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8581b-4020-41e0-87f2-09e472481fc4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.260522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.261131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.261402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.261814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.262652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:54.262957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.264812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.284760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 321/637] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:54.286650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.296904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.346918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.377305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487483ce-e534-42b6-8c43-01b806474e64 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.415897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.416537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.416803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.417111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.417419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c4b30-bf08-4e92-a382-d473719e8ac5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.417753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:54.418047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.419473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.431913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 317/638] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:54.437495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.458440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.459423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.459925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.460396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.542319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.543815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.550153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.556699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6e3b1-cfc3-4f4a-9556-9d048b9b48d0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.587370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.589815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.590797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.591077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.591375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.602673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:54.607981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:54.608936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:54.609751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 318/639] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:54.610429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.658489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 322/640] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:54.659446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.722190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830e7a-d595-4786-9537-415a0460d3ef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.761739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.762356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.762626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.762885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.766085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202816b5-91a1-4a3b-9406-b0e369b1961e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.770772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.772344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:54.783525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:54.784676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:10:54.785796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:54.789246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 319/641] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:54.789910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.806886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.807552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.807829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.808098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.809875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.816917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:54.820927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:54.825742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:54.827124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:54.828211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:54.831253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 323/642] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:54.832576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.909853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5166203-ed7e-4d8c-bb1c-d9f9763853b7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.944974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b8b0c-b33b-41b9-bc0a-16e848115878 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:54.947742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.948356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.948634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.948927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:54.949592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:54.949903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:54.951305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:54.959761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 320/643] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:54.960549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:54.984346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:54.984987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:54.985264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:54.985532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.004806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.006271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:55.022575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:55.023571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:55.024614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:55.024614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.024614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:55.024614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 324/644] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:55.024614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.046135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.071414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574790-006d-48df-b2e0-d63c97b7379e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.079993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.105613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.106219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.106493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.106762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.107508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:55.107802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.109962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.131990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 321/645] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:55.132856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.133117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dac66-ca74-4905-88f0-b80da278ada3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.170188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.170791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.171311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.171727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.172414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:55.172718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.174203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.187733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 325/646] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:55.187733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.239320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ffeb2-b141-4766-87eb-12aa09ebff49 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.279951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.280928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.281213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.281730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.283748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.293930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.294101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19524f5-d742-4a9d-a1a8-4d017ccaf9b9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.295690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.308210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:55.311445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:55.312869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:55.314338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:55.314338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.314338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:55.314338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 322/647] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:55.314338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.340587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.341194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.341469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.341734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.342482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:55.342867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.345008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.360732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 326/648] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:55.361564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.435077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2fb9d-bc6c-464a-b6dd-773ef77f6888 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.469827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6f3c-7376-45c5-852f-46131c1790ab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.475935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.476666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.476945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.477660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.505769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.506408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.506686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.506958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.517624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.519109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:55.534472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:55.535548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:55.536527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:55.536527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.536527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:55.536527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 327/649] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:55.536527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.537578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.554528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.556039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.563937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.643967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f394226-f9cd-473a-80b7-45bb96666760 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.666767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 323/650] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:55.666767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.682939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.683589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.683867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.684137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.684783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:55.685138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.686563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.699589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 328/651] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:55.700216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.759550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.774891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cba918-6a9c-49ba-83fd-ea4f52266843 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.785698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.802532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8d84-ffd8-43ef-8b77-cafcf813ca54 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.808491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.809117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.809388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.809663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.816183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.817633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:55.829485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:55.830551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 324/652] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:55.831542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.840941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.841555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.841834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.842107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.842801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:55.843135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.844490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.856051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 329/653] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:55.856833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:55.933420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf23ac-977a-4216-acf3-012dd739a61a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.955252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ddfd8-b42c-4c83-ae6d-a821b21677be None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:55.968936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.969574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.969854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.970127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.980949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.982496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:55.988439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:55.989059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:55.989166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:55.989628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:55.989628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:55.997933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-11bb9223-92a9-45f7-a9e7-f9a4ebab31ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:55.998348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:55.999389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:56.000255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:56.000255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:56.000255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:56.000463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.000539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 325/654] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:56.000854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70676-ab91-4629-b86c-b58a15328ba5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.001137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70676-ab91-4629-b86c-b58a15328ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.001410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70676-ab91-4629-b86c-b58a15328ba5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.002616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 326/655] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:56.003325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c70676-ab91-4629-b86c-b58a15328ba5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:56.016061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:56.017078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 330/656] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:56.017993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.021317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.112718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c70676-ab91-4629-b86c-b58a15328ba5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.115789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177028-5583-4d90-a72f-d937fcb8819a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.146489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.147097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.147406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.147674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.148357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:56.148480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.148654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.149102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.149374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.149639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.150145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.157135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.158578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.161829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 327/657] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:56.162702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7e447672-0372-4a50-9a94-2a5f363528a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:56.169707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:56.170970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:56.171932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 331/658] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:56.172547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.172547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.172688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.190084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:56.191281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:56.222972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.249922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.258495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 332/659] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:56.259329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.274956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc224b-7577-4fa2-94ec-8ec85ee7d80d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.312103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.313028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.313557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.314001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.314896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:56.315386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.317085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.330298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 328/660] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:56.331379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.360618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5cfa-7321-440f-ba28-fd2dd967fe7d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.398203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.399453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.399898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.400324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.401212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:56.401664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.403281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.420822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 333/661] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:56.421998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.440905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36447-9dab-4c17-8992-e9efe0973554 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.458670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.481660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.483775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.484386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.484675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.484982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.485962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:56.485962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.487409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.503229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 329/662] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:56.503229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.547090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d0c6-dca0-447c-afc1-088f8212380d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.584106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.584786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.584982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.585247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.585977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:56.586297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.587791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.612472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 334/663] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:56.612472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.625451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07121a64-baee-49cb-93f7-8c0f230dd901 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.667846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.668919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.669194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.669647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.679014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.680171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:56.691945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:56.692838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:56.693706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:56.694126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 330/664] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:56.694875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.726509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad062dc-700f-4ac9-bda2-490222c37c3c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.738161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.747399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.765514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.766448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.766789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.767064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.808124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ade0-597b-4aa3-be0a-d8c829f56434 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.840792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:56.842303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:56.846292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:56.846932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:56.847305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:56.847513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:56.859112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:56.865260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:56.866186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:56.867001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 331/665] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:56.867741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.947645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 335/666] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:56.948765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:56.963027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:56.986289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782d69-a6fd-451b-8055-e3cd4bd4f56b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:56.988004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.025439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.025965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.026245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.026509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.057631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853881f0-b8a5-4e64-ab9e-e20b7d3e7dc8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.095568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.095759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.096307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.096629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.096904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.097007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.097621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.097925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.099377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.116725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 336/667] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.116725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.182199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.214191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc104-139a-41d1-97b9-b640d4dc9ce4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.219549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 332/668] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:57.219549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.219549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.254823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.255451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.255727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.255993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.256706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.257006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.258362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.270770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 337/669] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.270770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.327573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346aeb-58c3-4d84-8161-12f8532f2a72 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.363348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.363998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.364274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.364529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.369674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec047e-66d7-4669-99d1-c6a42eb96288 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.375232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.376829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:57.392682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:57.393844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:57.394939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:57.394939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.394939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:57.398592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 333/670] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:57.399442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.401022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.407901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.408510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.408786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.409054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.410245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=c891710c74ca4a4dae183c7979152109) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.410551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.412336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.423229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 338/671] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/role_assignments?user.id=c891710c74ca4a4dae183c7979152109&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.423229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.486271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.534518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caf486-544e-4572-a2ad-d03e24ef7610 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.547521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107e659-f418-4356-85f6-c5e48b0a8b3e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.573308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.574047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.574385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.574721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.586746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.588228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.595800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.596573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.596906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.597231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:57.606634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:57.607629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:57.608741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:57.608741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.608741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:57.611168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.612827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.615288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 339/672] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:57.616312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:57.629375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:57.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:57.631270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:57.631270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:57.631270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:57.633190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 334/673] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:57.634191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.680098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.745006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece595-ae18-4a8a-88b6-65e46e07da18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.757242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3064f-02ae-4cfd-bf8e-cb82a10bb47b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.771534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.788518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.789476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.790172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.790449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.791655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.791984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.793512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.799808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.800705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.801191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.801690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.802981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.803532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.805920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.811240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 340/674] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.811240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.824636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 335/675] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.825684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.915660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-6f0b-435f-a818-64901d7378a5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.927435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:57.937143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13baf5-fa0b-4a41-993c-dc67ca5060f1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:57.955116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.955952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.956325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.956696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.957416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:57.958021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.959307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:57.972463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 341/676] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:57.973690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:57.976223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:57.977127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:57.977559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:57.978062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:57.986297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:57.988154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:58.000952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:58.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:58.002717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:58.009680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 336/677] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:58.010986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.047561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.079535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba836-d5b0-44ab-b4d5-bb29911b56d3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.122486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720dca0-967a-4416-b8ea-d6be094d0ead None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.123177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.124416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.125784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.126271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.137279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.138712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:10:58.153298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:58.154275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:58.155494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 342/678] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:58.159340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.172292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.173766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.174331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.174794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.184486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.186707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.192552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:58.200865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:58.201965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:58.203246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:58.209168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 337/679] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:58.210102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.292130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09b89-ec7d-449a-bf06-35399ca82d71 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.303068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.325755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af6c02-b28e-4413-8825-194bf395c290 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.330802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.331444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.331759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.332028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.332715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:58.333015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.334435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.352347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 343/680] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:58.352347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.378239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.379355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.379891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.380689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.381821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:58.382280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.384787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.408513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 338/681] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:58.409583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.450306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.469515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1933-6536-4985-996f-74ec29acc518 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.507910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.508528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.508805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.509420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.509766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:58.510066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.511542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.528187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 344/682] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:58.528187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.540185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b001b-e2cf-4371-b177-1c8d1e96d6e1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.577619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.578477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.578749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.579015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.579771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=d812f7fb4e114ae4ab5d7c2a111df3a1) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:58.580081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.581496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a4af7-4685-4334-a2a8-ea9fa3ada9a5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 339/683] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/role_assignments?user.id=d812f7fb4e114ae4ab5d7c2a111df3a1&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd640-dc0b-4f67-b2b6-455198e5aebb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd640-dc0b-4f67-b2b6-455198e5aebb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd640-dc0b-4f67-b2b6-455198e5aebb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 340/684] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:58.594934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd640-dc0b-4f67-b2b6-455198e5aebb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.617119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.650853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639f62-22fb-4715-a227-1caf6ef61501 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.690033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.690654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.690926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.691191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.711390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:58.762107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd640-dc0b-4f67-b2b6-455198e5aebb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:58.770865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.772417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.802095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:58.803665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.804143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.804748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.805965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=bf8d5b7a906244a9997fcabc92b00e04) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:58.806684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:58.808929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c110-45cd-4c0a-bebd-2b856d6134a4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:58.816588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 341/685] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/role_assignments?user.id=bf8d5b7a906244a9997fcabc92b00e04&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:58.818583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366165db-323f-459f-975a-e339a7e8aacd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:58.819081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366165db-323f-459f-975a-e339a7e8aacd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:58.819568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366165db-323f-459f-975a-e339a7e8aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:58.846996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-366165db-323f-459f-975a-e339a7e8aacd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:58.849615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-366165db-323f-459f-975a-e339a7e8aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:58.892757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 345/686] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:10:58.898395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:58.944389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 342/687] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:58.964603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.018936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7eb6c-ed9f-4b37-89e5-e7a70a408886 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.054573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.055551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.056037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.056514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.067459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.069183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:59.084918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:59.085897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:59.086761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:59.086761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:59.086761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:59.088576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 346/688] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:59.094214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366165db-323f-459f-975a-e339a7e8aacd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.096911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.202954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366165db-323f-459f-975a-e339a7e8aacd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.233958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.243679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.244962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.245425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.245872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.247030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:59.247559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.249946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.266207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 343/689] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:59.271436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.336408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.351157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95adf4-7533-42e5-960d-5a31580de90c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.363441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.377548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cc3a8-0d57-4e8a-a18f-cb0b4bccc6a0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.390338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.391442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.392093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.392607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.404723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:10:59.410349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:59.411287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:10:59.412126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:59.413789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.414419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.414690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.414956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.415747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 347/690] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:59.423252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.427089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.428630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:10:59.450268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:59.451276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:10:59.452418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 344/691] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:10:59.458085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.575519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6399-bf53-444d-8de7-25fde927bd4e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.593083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a8b4-3ea4-45f4-97f7-e99868fe5309 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.621296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.622750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.624310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.624920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.625374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.626817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:59.627600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.629598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49a815-9d8c-4fb2-b60a-339915e0d747 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.635496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.636658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.637005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.637341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.638358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:10:59.638726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.640317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242a0e7-28cf-496c-8be7-577d970ab977 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.644248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 348/692] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:59.646795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ec3-2478-4507-8487-30209ab3b914 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.646795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ec3-2478-4507-8487-30209ab3b914 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.646795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ec3-2478-4507-8487-30209ab3b914 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.646795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 349/693] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:10:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:10:59.652083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573ec3-2478-4507-8487-30209ab3b914 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.664099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 345/694] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:10:59.665989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.666281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.666549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.685561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:10:59.691064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:10:59.692302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:10:59.757230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573ec3-2478-4507-8487-30209ab3b914 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.783286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 346/695] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:10:59.784781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.806388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:10:59.807025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:10:59.807329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:10:59.807601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:10:59.827566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:10:59.828947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:10:59.857889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:10:59.858877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:10:59.859791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:10:59.859791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:10:59.859791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:10:59.859791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 350/696] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:10:59.868943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:10:59.969967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e78677-cf73-4a30-ac6f-b5b37a4b7ec9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:10:59.991227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.024214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5740e2-d6ca-4e97-a04e-48d8552bf0b7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.032452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.063223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.063841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.064118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.064482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.065180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:00.065481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.066898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.071911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.072545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.072823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.073099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.073836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8c7c13d179cf442999070e1e0d1cf89b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:00.074148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.075721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.085548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 351/697] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:00.087405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.097260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 347/698] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:10:59 2022] GET /identity/v3/role_assignments?user.id=8c7c13d179cf442999070e1e0d1cf89b&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:00.098128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.278030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0c46-5351-45f4-82c3-edfaa0a9a934 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.314766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120f9f-1cc0-49c6-8ed8-e9e4b20c3f75 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.336600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.337138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.337414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.337685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.338285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.339790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:00.356421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:00.357518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:00.358595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 348/699] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:00.366123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.372467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.373459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.373939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.374405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.376800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.386160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.388029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:00.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:00.402782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:00.403826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:00.406518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 352/700] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:00.412076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.420870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.508258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05503-289e-4ac8-b2f0-eb0af3903e5b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.541767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98b13c-0473-40fc-9547-ea1d6e639f06 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.555927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.557492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.557973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.558447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.559403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:00.560151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.561796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.568496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 349/701] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:00.573668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.582548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.583262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.583547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.583817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.584614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:00.584920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.586419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.610987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 353/702] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:00.612259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:00.672998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.703448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5899-decb-4f78-8a43-8d08e0db8624 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.706898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:00.736429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a530d76-843a-4834-bcb0-e7f82f354509 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:00.745091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.745829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.746201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.746584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.747351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:00.747966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.749823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.760250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 350/703] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:00.778321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:00.779282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:00.779741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:00.780157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:00.867434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:00.869140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be052dae-a192-4d70-b3ef-2d749fb7905a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:00.948199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:01.009892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 354/704] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:11:01.016046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.017513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f68-e30c-405b-9c2c-798b47f74b59 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.017800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f68-e30c-405b-9c2c-798b47f74b59 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.018077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f68-e30c-405b-9c2c-798b47f74b59 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.019716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 355/705] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:01.027881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.028178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.028424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.053626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:01.054769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:01.171978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171e9d1-dab2-45e6-bec9-a713bba2208b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.185734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 356/706] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:11:01.231117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.231802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.232127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.232405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.248010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.249685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7c5f0310-6c7a-4af4-a1d4-983476deba14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:01.267246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:01.268194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:01.269058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:01.269058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:01.269058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:01.269058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 351/707] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:01.274094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.310909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f2c9-d373-4d11-82ae-d1cfa322af0f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.311591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f2c9-d373-4d11-82ae-d1cfa322af0f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.311873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f2c9-d373-4d11-82ae-d1cfa322af0f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.314088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 352/708] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:01.321525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.321945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.322358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.352961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:01.354240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:01.381002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:01.395589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:01.414624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4b5c-371c-4588-9778-228d6b92344c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.493089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.493713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.493988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.494253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.494902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:01.495216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.499785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.504200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 353/709] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:11:01.518041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 357/710] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:01.519377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.552822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.680909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9225-4a0d-4da8-ac2c-545af5a6f461 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.722658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525dbaa-8a34-4bec-b69b-696f6483bc73 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.750355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.751900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.754726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.755569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.766092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.769156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.772568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.773431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.773899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.774354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.786188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.787930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:01.797726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:01.798600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:01.799500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:01.799988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:01.805630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:01.806604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:01.807588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:01.807588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:01.807588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:01.807763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 354/711] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:01.809668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 358/712] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:01.819219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.819406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:01.852974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:01.925236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96775d44-b654-428d-a9f3-caca62354aaf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.954239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8526-ac07-4444-847c-f3a7ddbf4ba1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:01.968604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.969890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.970662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.971152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.972207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:01.973061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.974637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.990231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:01.990845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:01.991118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:01.991429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:01.992125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:01.992421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:01.998631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:01.999219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 359/713] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:02.000772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:02.015536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 355/714] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:02.016423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:02.065769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:02.093792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:02.115543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29aa79-305c-4553-a274-1f911542a48f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:02.129460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680ef7-2c65-4d0c-8ceb-f9c1feb58542 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:02.152032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:02.153155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.153660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.154132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.154972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:02.156688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:02.165825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:02.166439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.166713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.166982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.167672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:02.169110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:02.169993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:02.171085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:02.172380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:02.175080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 360/715] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:01 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:02.176029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:02.206880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 356/716] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:11:02 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:02.206880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:02.375557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3fa8-b038-4ce1-b2e1-524f2c7351d3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:02.396791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:02.405126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd437e-36f2-453a-bf59-064e8bc6d927 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:02.417454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:02.418300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.418727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.419302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.420416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:02.420926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:02.422558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:02.429486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 361/717] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:02 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:02.442713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:02.453654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:02.454658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.455186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.455777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.456680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:02.457207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:02.458840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ea008-7e1c-44ba-a38e-6b55cafb4eb4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:02.471422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 357/718] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:02.478970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:02.597905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120add-5716-4cf6-a2b1-a4304e1576e5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:02.635621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:02.636566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.637060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.637540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.638458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] RBAC: Adding query filter params (type=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:02.639030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:02.640713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3134808-a91f-4191-b6c8-b14abf573d23 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:02.647320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 362/719] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:02.693612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08e3-99e0-49cf-b834-62593ef061e6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.694288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08e3-99e0-49cf-b834-62593ef061e6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.694768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08e3-99e0-49cf-b834-62593ef061e6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.696765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 358/720] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:02.702562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5290-0283-4777-a1c0-35142f378394 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.703231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5290-0283-4777-a1c0-35142f378394 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.703715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5290-0283-4777-a1c0-35142f378394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.728335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-031e5290-0283-4777-a1c0-35142f378394 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:02.730469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-031e5290-0283-4777-a1c0-35142f378394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:02.795450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:02.826303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 363/721] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:11:02.943048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f97c-ab5a-4005-b45c-a8afdbe3d23a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.943849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f97c-ab5a-4005-b45c-a8afdbe3d23a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.943849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477f97c-ab5a-4005-b45c-a8afdbe3d23a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.945761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 359/722] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:02.953708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:02.953990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:02.954259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:02.972758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:02.973936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:03.044932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 364/723] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 05:11:03.206400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477f97c-ab5a-4005-b45c-a8afdbe3d23a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:03.326889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477f97c-ab5a-4005-b45c-a8afdbe3d23a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:03.369772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:03.370827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:03.371324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:03.371784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:03.388278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:03.388465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:03.389964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:03.390858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:03.391727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:03.395327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 360/724] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:03.400455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:03.492550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:03.542927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583396-e29e-44f0-a96f-81a42f317a71 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:03.572525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f11ef-7260-4496-ba89-fdac462557fc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:03.583521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:03.595907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:03.596522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:03.596848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:03.597170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:03.597838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:03.598176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:03.599653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:03.619139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 361/725] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:03.625467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:03.628214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:03.628831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:03.629106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:03.629370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:03.630030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:03.631435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:03.649976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 365/726] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:03 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:11:03.778795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0b39-3e4e-4877-8e8b-365cbc273f85 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:03.793309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:03.836147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:03.836782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:03.837053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:03.837316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:03.849383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:03.851191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:03.866965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:03.868322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:03.869246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:03.869246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:03.869246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:03.875346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 362/727] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:03.878494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:03.990453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106962-d54d-47d3-bfb6-9c90b0a9fc4b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:04.025317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:04.026280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.026777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.027276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.028124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:04.028737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:04.030781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:04.047323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 366/728] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:04.050147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:04.156790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23b61-2010-469a-a93c-7c6e452dc7bd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:04.191974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:04.192996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.193522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.193990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.202333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:04.204138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:04.215746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:04.216715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:04.218207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:04.223616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 363/729] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:04.226836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:04.269669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:04.376727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a3e2-8416-4e2b-b780-a35fd65b92a5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:04.437066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:04.437706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.437991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.438268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.439021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:04.439356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:04.440805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:04.462813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 367/730] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:11:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:04.471291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:04.506095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:04.603733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b71ce-139f-4551-bed0-f4bd895eac44 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:04.640974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:04.641508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.641787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.642055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.715214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:04.716689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3460fd-5b12-4a45-bbac-254cfeaf0c96 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:04.739306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:04.828062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 364/731] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 05:11:04.832327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:04.843788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b480c-e2bd-4701-a366-bcf29ccc9576 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.844085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b480c-e2bd-4701-a366-bcf29ccc9576 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.844330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b480c-e2bd-4701-a366-bcf29ccc9576 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.846378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 365/732] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:04.851478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472233-971f-4f66-ac17-76b8c05323df None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.851766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472233-971f-4f66-ac17-76b8c05323df None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.852036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472233-971f-4f66-ac17-76b8c05323df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.872734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-65472233-971f-4f66-ac17-76b8c05323df None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:04.873977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-65472233-971f-4f66-ac17-76b8c05323df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:04.976051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 366/733] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:11:04.977322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace2b4-2dd5-432d-96f2-8d6f7128f631 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.977689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace2b4-2dd5-432d-96f2-8d6f7128f631 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.977958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace2b4-2dd5-432d-96f2-8d6f7128f631 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.983271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 367/734] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:04.984695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc801d5-96cc-42d7-8d50-44cbf34a5c43 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:04.984978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc801d5-96cc-42d7-8d50-44cbf34a5c43 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:04.985246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc801d5-96cc-42d7-8d50-44cbf34a5c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:04.987313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.010490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2cc801d5-96cc-42d7-8d50-44cbf34a5c43 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:05.011715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2cc801d5-96cc-42d7-8d50-44cbf34a5c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:05.027367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e51d48-8a0f-4135-bacf-d18d7f97a9fb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.064194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.075765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.076865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.077288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.078039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.090679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.092439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.093531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 368/735] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:11:05.094936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe4b8-3666-4108-b3a7-2a082c1b6f25 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.095232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe4b8-3666-4108-b3a7-2a082c1b6f25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.095507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe4b8-3666-4108-b3a7-2a082c1b6f25 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.097003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 369/736] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:05.108747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:05.109879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:05.110962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:05.110962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:05.110962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:05.111282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.111282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.111282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.112947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 368/737] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:05.120054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.146901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:05.148108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:05.246266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f1e6d-941e-489c-8c02-2db109ca3886 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.285327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.285945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.286221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.286491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.287134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:05.287466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.288840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.291861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.303507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 369/738] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:05.304445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.304834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 370/739] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 05:11:05.316604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.413360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806762f-eb1d-4ac3-bd14-43aaec2a59f4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.454313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.454952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.455250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.455525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.459693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78748e3-82bd-40b3-8268-689b1f02a2b5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.469146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:05.475236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:05.476150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:05.476967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:05.483303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 370/740] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:05.483303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.491290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.495961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.498564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.499543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.500658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.509916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.511369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:05.522727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:05.523823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:05.524948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:05.528791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 371/741] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:05.529646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.562029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.618698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb90b5e-f4a0-44e6-81f8-d40fbe086a9d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.635947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b9f5-ef29-4fd7-a87d-745d2f8855cd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.656905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.657926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.658486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.658956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.659820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.661598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.668490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.669159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.669434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.669694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.670778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:05.671112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.672664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.679126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 371/742] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:05 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:05.679776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.686453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 372/743] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:05.688027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.736742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.826856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e49f2-e8d3-426e-921e-58fe2a33dc60 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.837726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab84ef-3610-442a-9e5b-337f1d693114 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:05.855307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:05.864582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.865220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.865492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.865753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.884101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:05.889905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:05.890870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:05.892000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 373/744] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:05.892850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:05.893346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:05.894007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:05.894314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:05.894586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:05.895357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:05.895656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:05.897202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:05.915485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 372/745] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:05.916753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.003614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.016597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d6e-661c-45f7-b7c7-d23de3960ef8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.044313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef95-96a7-4d69-a885-6ad7518eba93 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.065775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.066451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.066671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.066933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.084166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.086194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.086410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.087114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.087560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.087916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.088803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:06.089148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.090675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.100067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 373/746] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:06.101052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:06.106395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:06.107863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:06.109139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:06.109139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:06.109139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:06.110909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 374/747] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:06.111917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.152123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.233106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42579960-f9e2-4d3c-9017-e25ed359b856 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.271087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.272126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.272630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.273103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.273991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8c7c13d179cf442999070e1e0d1cf89b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:06.274303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.275787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.291228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 374/748] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/role_assignments?user.id=8c7c13d179cf442999070e1e0d1cf89b&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:06.291228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.363001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8e68-d43c-4822-8d03-2534492bf5db None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.402604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.403405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.403743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.404151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.416614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.418308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.421860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.429671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.434911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c468-cec8-41ad-a982-66dc9c8e0c01 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d3a96223-c1d6-42e5-b75e-21153e1194a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:06.439807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:06.440771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:06.441641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:06.441641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:06.441641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:06.443853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 375/749] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:06.445450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228502c-196c-4717-bb65-a6b7ee12d467 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.445937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228502c-196c-4717-bb65-a6b7ee12d467 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.446400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228502c-196c-4717-bb65-a6b7ee12d467 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.447921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 376/750] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:06.448859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228502c-196c-4717-bb65-a6b7ee12d467 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.482498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.483152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.483464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.483736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.484415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:06.485172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.486820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b584-04c1-472b-ac5d-c07f3ada9a08 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.503132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 375/751] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:06.505034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.505492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.505773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.529863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:06.531057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:06.574666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228502c-196c-4717-bb65-a6b7ee12d467 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.627306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 376/752] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:06.627306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.627563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.627563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.627563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.627563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.627834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:06.627834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.627834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.649260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 377/753] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:06.656823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.743991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.788010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:06.795486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b881f-8a1c-4ff4-b8b8-779edcb04869 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.815988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01279f-47e2-48f7-bbfc-e1f35bcc9b3a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:06.836581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.837580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.837865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.838138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.846681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.848177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:06.861242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:06.862214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:06.863441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 378/754] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:06.869316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:06.892914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:06.893476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:06.894458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:06.894731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:06.906849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:06.909207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:06.934283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:06.936959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:06.939231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 377/755] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:06.948669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.053458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30f42-b5a4-48c4-8aec-92b0fd35d358 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.073715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.093780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf5d0-9fcc-462e-9a2a-7fe551406a64 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.103938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.105150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.105888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.106365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.107530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:07.108043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.110437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.130135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.130787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.131064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.131372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.132107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:07.132407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.133788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 379/756] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:07.133897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.134913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.163164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 378/757] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:07.164039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.173188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.255024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db428-78f4-46b8-92c5-2fb56f84c5bb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.282029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6286f7-c9b6-4e8f-8799-640356f41204 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.291822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.292510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.292786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.293054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.293636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.295296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:07.304794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:07.305783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:07.306613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 380/758] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:07.312193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.329594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.330421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.330645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.330913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.342018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.343610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.360004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:07.365977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:07.366923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:07.368180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:07.368180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:07.368180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:07.368180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 379/759] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:07.372009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.445507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a732-dec5-4eb7-8527-2f72db587363 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.448629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.495398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.496440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.496938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.497405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.509370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c5ae7-fecf-48aa-90cc-b2fb7b9b8bdb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.547063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.547722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.547996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.548317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.549037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:07.549341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.550693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.561447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 380/760] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:07.561447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.576890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.578662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.619553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.664055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff1b3-6fd9-4d7f-8199-643e82290304 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.689106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 381/761] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:07.689106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.690189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.704128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.704662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.704937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.705196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.705838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:07.706135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.707513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c26a2-0c94-4a35-aa15-1a9483f2ff68 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.719641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 381/762] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:07.720826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64365-c2f4-4354-a40e-d417495c7920 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.721103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64365-c2f4-4354-a40e-d417495c7920 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.721373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64365-c2f4-4354-a40e-d417495c7920 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.726518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 382/763] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:07.726518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64365-c2f4-4354-a40e-d417495c7920 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.800897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824720b8-33ba-4ccd-85bd-c19acfaccf34 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.829824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64365-c2f4-4354-a40e-d417495c7920 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.836871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.837791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.837791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.838083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.838634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:07.838929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.840330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.845527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 382/764] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:07.846325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:07.848796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.872259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.872890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.873211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.873482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.883481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:07.884923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2be7a2eb-d9f1-4157-b9f3-d60040a291b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:07.900979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:07.901950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:07.902848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:07.902848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:07.902848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:07.904643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 383/765] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:07.905949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.906387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.906805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:07.925360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:07.926800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:07.956081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:07.960453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314d77-e820-4e17-b7af-009dce4e9c27 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:07.994778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:07.995423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:07.995702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:07.995976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.001284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 384/766] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:08.002402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.012471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.014361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:08.026003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:08.027028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:08.028179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:08.031990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 383/767] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:08.032850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.096632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.130105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37371af0-7e9a-4f6b-a3a7-867b1e90e441 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.144089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284fd32-8c67-4b9f-b284-cb406d7c0f58 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.164923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.165544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.165828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.166104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.167025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] RBAC: Adding query filter params (interface=public, service_id=4f504814773447318767462758fbf47c, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:08.167140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.168759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.181546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 385/768] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/endpoints?service_id=4f504814773447318767462758fbf47c&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.182470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.186865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.187695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.188134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.188538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.189353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:08.189790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.191722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.210861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 384/769] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.211739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.227570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.294536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d65d-a6a9-437b-8916-7aebd0790244 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.319224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16f2e-1ffb-423f-aad7-8273850dc52c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.327827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.328408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.328683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.328947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.329629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:08.329929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.331395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.342015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.343820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 386/770] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.344748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.359824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.360465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.360727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.360998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.361610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.362991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e4524-01c8-44e7-aff7-75cf069debfb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.368432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 385/771] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.369665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd52-9b7e-4ae1-9119-30edd313745e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.369951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd52-9b7e-4ae1-9119-30edd313745e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.370283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd52-9b7e-4ae1-9119-30edd313745e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.371839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 386/772] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:08.372593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fd52-9b7e-4ae1-9119-30edd313745e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.461563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.479560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94f49-0e8b-4374-b99e-eb04e42885e4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.496151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fd52-9b7e-4ae1-9119-30edd313745e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.521616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.523494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.523494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.523494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.531314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.532797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.536400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.537031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.537301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.537559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] PATH_INFO: `/v3/services/network` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.538154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.539872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:08.544087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:08.544985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:08.545872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 387/773] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:08.546825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-08906d78-fa0c-4796-bd9e-0d976da70622 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:08.550227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:08.551362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:08.552207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 387/774] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:08.553007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.553579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.553579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.575934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:08.577582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:08.631728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.650918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580375-a804-474f-9736-3ce8df1cac5b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.653594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 388/775] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:08.654574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.716737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.718224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.718498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.719023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.721634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=5fde80d2e5cd4553b1b282284825d3d6, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.723621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.747132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 388/776] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:08 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:11:08.748172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.764905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:08.828381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee37c4-91c5-411d-b61e-032f89ffcb0c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.884655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebf54-521b-46ab-a039-6f2fa1146290 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:08.925271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.926267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.926686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.927450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.928068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] RBAC: Adding query filter params (name=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:08.928545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.930275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.935173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:08.935837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:08.936201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:08.936618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:08.937549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:08.937894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:08.938253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 389/777] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.939272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:08.943578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:08.956337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 389/778] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:08.957565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.019752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.022647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.054841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623c6de-d163-4173-8829-2d0fd160c1db None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.091064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.091776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.092073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.092345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.092498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531ece-f7d0-4852-b221-2b67daf2ca3e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.108522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:09.114835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:09.116008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:09.117109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 390/779] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:09.118454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.133100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.134015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.134293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.134822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.135491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] RBAC: Adding query filter params (type=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:09.135789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.137671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.143805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 390/780] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:09.144619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.250179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9faf-fbc2-41af-8822-d71a8b600b18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.262418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877e64-2904-40f5-857c-8d59783d7e9a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.265075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.280472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.285867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.286490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.286762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.287027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.287776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=837c4c6e2f1743eabe53bf75e01bab1c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:09.288077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.289836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.302112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 391/781] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/role_assignments?user.id=837c4c6e2f1743eabe53bf75e01bab1c&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:09.303159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.312416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.313064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.313338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.313606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.314306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:09.314605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.323233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.327070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 391/782] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:09.336364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.518211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b526d-92d9-4be3-9a1c-a9de11d8b7c2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.529165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1e99-3bbe-4eea-8867-bec26cb46e15 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.553151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.553772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.554041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.554299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.565196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.566639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:09.581228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:09.582172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:09.583062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:09.583062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:09.583062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:09.583062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 392/783] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:09.587797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.608426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.619627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.620251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.620582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.620857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.621610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] RBAC: Adding query filter params (interface=public, service_id=970b3116a92d4e318aeeccd2fc844367, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:09.621920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.623572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.637992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 392/784] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/endpoints?service_id=970b3116a92d4e318aeeccd2fc844367&interface=public®ion_id=RegionOne => generated 194 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:09.644290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.719146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e019e3-aa12-4ccd-9638-df43a0e946f0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.738952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.780039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.780681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.780942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.781198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.781840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:09.782329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.783595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.785308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5478-fabf-4811-8a66-a4a4d653ab40 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:09.805705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 393/785] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:09.811502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:09.846610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:09.847512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:09.847961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:09.848375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:09.849136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:09.850646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:09.860277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 393/786] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:09.943652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:09.971325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bb17e-3c58-4a24-afbe-a3a9dfe33c38 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:10.019415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:10.020064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.020334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.020604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.029950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:10.031666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:10.043765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:10.044702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:10.045682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 394/787] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:10.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:10.176954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d7fb-ef43-4364-aeac-949e5651b83e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:10.204588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:10.224887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:10.225560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.225839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.226169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.226914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:10.227227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:10.228673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a6240-dd2e-4af1-a868-150e24bb89d1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:10.252964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 394/788] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:11:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:10.258150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:10.341786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94fd59-3e3f-46dd-99a2-29583ef62f16 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.342234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94fd59-3e3f-46dd-99a2-29583ef62f16 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.342656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94fd59-3e3f-46dd-99a2-29583ef62f16 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.345548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 395/789] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:10.349661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.349946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.350220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.480051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9041a-caab-4d7b-9d77-43473f59b6d6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:10.489980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:10.491207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:10.571408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 396/790] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:10.584007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:10.584679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.584955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.585217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.603572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:10.607884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:10.609895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:10.629618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:10.630610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:10.631505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:10.631505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:10.631505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:10.635450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 395/791] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:10.636524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:10.785952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dbf4e-5b1d-4b8a-8494-716d6a02df7b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:10.807191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:10.838227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:10.838847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:10.839120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:10.839409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:10.840058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:10.840354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:10.841715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:10.858277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 397/792] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:10.863743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:10.948083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.062075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634cc2-b293-49c4-8e82-d2cdaeb58ea0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.098706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.099397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.099671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.099939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.100542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.102303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.110243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66cf8-4d39-4476-99f4-5bc7d2322711 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d9b2311d-80fc-4276-b603-a1bd57ebe105 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:11.113953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:11.114896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 05:11:11.115780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:11.119332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 398/793] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Sep 2 05:11:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:11.121063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9030a-497e-44b7-94ea-3b7ecd0e7328 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.121349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9030a-497e-44b7-94ea-3b7ecd0e7328 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.121621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9030a-497e-44b7-94ea-3b7ecd0e7328 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.128723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 399/794] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:11.128723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9030a-497e-44b7-94ea-3b7ecd0e7328 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.166008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.166643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.166918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.167186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.173740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:11.178059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.181100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1df11638-d936-4b56-af3f-145b0fd9f65f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:11.196827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:11.197751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:11.198625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:11.206021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 396/795] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:11.206021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.206021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.206021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.228822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:11.230827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:11.261843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9030a-497e-44b7-94ea-3b7ecd0e7328 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.295926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:11.305900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.307013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.307593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.308046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.309106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:11.309983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.312221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.319407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 400/796] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:11.320454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.335240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 397/797] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:11.335240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.512391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:11.516737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c34d9-b1e1-4358-9220-2835b4e0bbe8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.526958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0566-78ae-4c36-8c74-c1714fff8ba3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.558007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.558692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.559038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.559417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.560172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:11.560637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.562009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.562670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.562784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.562876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.563141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.563798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:11.564094 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.565431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a3b74-b4c8-4298-a4f1-3f614ac2673a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.570345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 398/798] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Sep 2 05:11:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:11.571507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104702-348d-49c0-b797-8511e04a43ca None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.571783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104702-348d-49c0-b797-8511e04a43ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.572042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104702-348d-49c0-b797-8511e04a43ca None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.577330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 399/799] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:11.578618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.578900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.579171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.580725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 401/800] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:11.581683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.597060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:11.598229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:11.643310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:11.675300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 400/801] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:11.676316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.698061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281e31-0c8f-40cd-b405-abc1138441c0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.740553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.741318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.741830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.742330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.743433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.745572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.783360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 402/802] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:11.784531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.818602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75c64-f3a5-443a-ae8d-2037b90b61b4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:11.824305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:11.884382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:11.885305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:11.885782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:11.886273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/8c7c13d179cf442999070e1e0d1cf89b/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:11.888403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=8c7c13d179cf442999070e1e0d1cf89b, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:11.890145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:11.911518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 401/803] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:11 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/8c7c13d179cf442999070e1e0d1cf89b/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:11:11.954352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:11.974891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4891e-3b94-4ced-acf4-df16ca4df330 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.019434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.026034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.026695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.026972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.028164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.042455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:12.049732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:12.050761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:12.051636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 403/804] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:12.059581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e86ce-da02-4a54-a1c9-057b85941ed0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.167082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.176924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.177901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.178403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.178875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.196760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:12.203269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:12.204214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:12.205029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:12.205659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307fb09-64eb-4fe0-a78d-58638df90236 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.207803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 402/805] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:11:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:12.213583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.263175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.263994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.264352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.265334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.266014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:12.266311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.267945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.288491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 404/806] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:12.294168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.356398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.370075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e2448-44f0-46c8-a767-08906d7199e4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.421952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.422515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.422837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.423111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.423883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:12.424189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.424739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1831-4b03-4603-85fd-95d2ee126b09 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.425584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b91e6-626d-4e98-9088-11b7013062ca None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.441991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 403/807] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:12.441991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ce9e-b036-46f5-9015-82e233d2484f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.441991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ce9e-b036-46f5-9015-82e233d2484f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.441991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ce9e-b036-46f5-9015-82e233d2484f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.441991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 404/808] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:12.444064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0ce9e-b036-46f5-9015-82e233d2484f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.479816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.480729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.481174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.481582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.489310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.495069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.496826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ec3a1775-890d-4546-b293-6b0e1711fdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:12.511996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:12.512976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:12.513902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:12.513902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:12.513902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:12.515761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 405/809] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:12.517122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.517541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.517965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.536260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:12.537676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:12.560297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0ce9e-b036-46f5-9015-82e233d2484f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.596387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.597055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.597333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.597605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.606737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 406/810] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:12.607925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.614210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.619902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:12.645196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:12.646263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:12.647133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:12.647133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:12.647133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:12.650901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 405/811] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:12.651834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.658724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.718486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8efb1-d055-47f0-9da5-60475eb10bd5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.755539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:12.787107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.787744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.788017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.788279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.788974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:12.789267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.790738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.807771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 407/812] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:12.814611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.857391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575267d6-e283-42f2-a023-f875bd74aeae None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.913313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47c6c-a6eb-45d4-a40a-306cb1c279e7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:12.952490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.953131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.953405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.953669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.961420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.962850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.964823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:12.965443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:12.965720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:12.965988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:12.966640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:12.967037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:12.968418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:12.981311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 406/813] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:12.981829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:12.982993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:12.984605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:12.985135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:12.987023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 408/814] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:12.992421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.050304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.065147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.116273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7519-593e-4f6a-8fee-d5b84e0c21dd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.124695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185c99b-7541-4f1f-a1da-2865b7c8e0ff None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.164889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.165990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.166129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.166630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.166736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.166965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.167261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] PATH_INFO: `/v3/services/network` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.167641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.167853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.168755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:13.169238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.169449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.171268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:13.179850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:13.180848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:13.186802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 407/815] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:13.187996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.199068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 409/816] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:13.200335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.302230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee26eb-d1c9-4184-86d1-df8c6bd9ddeb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.322974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.328473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686fe6a-1569-400e-9899-e3389a067179 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.333555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.342872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.343846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.344397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.344891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.353080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.354768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:13.367282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:13.368972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:13.369906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:13.371538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 408/817] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:13.372574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.378558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.379211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.379503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.379776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.380422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] RBAC: Adding query filter params (name=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:13.380724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.382102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.389694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 410/818] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:13.389694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.503901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48928f4-c1ec-460d-b805-a6fe9e872c8b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.510018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fa71-7b7b-467a-a51f-2c117c29d074 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.541135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.541918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.542476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.542648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.543528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:13.543936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.545604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.557007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.557835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.558259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.558690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.570972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 411/819] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:13.570972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.592151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.646018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.663652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.666064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.684071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42f34b-7ee5-4405-87a1-7af3ef372c4a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.723252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.724280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.724527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.724893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.725652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:13.726338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.727827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.734067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 412/820] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:13.739474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.805418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 409/821] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:13.805418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.838341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.858014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0c46c-46e5-4c92-b2e4-dc96728702a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.896510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.897307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.897681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.898048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.909974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.911746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:13.924423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:13.931274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:13.932436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:13.933524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:13.933524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:13.933524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:13.940023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 413/822] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:13.941203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:13.942489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858bc4a-01ff-4029-bd4d-e4da8b0c513c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:13.980168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:13.980784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:13.981063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:13.981333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:13.981993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:13.983449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.005024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 410/823] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:14.005834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.047474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70d925-603f-4abf-809e-9ca597bfb7ba None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.088130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.095090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.095708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.095980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.096285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.108333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.110034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6a05f311-fedc-4b8d-8fa0-fc4754d03437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:14.126588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:14.132758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:14.133729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:14.133729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:14.133729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:14.133917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985108-99a3-4eab-a042-e8909fcce369 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 414/824] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cd815-15cc-4810-87ec-a7d7ffeb110c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cd815-15cc-4810-87ec-a7d7ffeb110c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cd815-15cc-4810-87ec-a7d7ffeb110c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 415/825] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f90b-d394-44c3-acb0-54e23c249f84 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.133993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f90b-d394-44c3-acb0-54e23c249f84 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.134397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f90b-d394-44c3-acb0-54e23c249f84 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.135073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 416/826] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:14.135336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18f90b-d394-44c3-acb0-54e23c249f84 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.181860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.182979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.183334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.184644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.184644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:14.184644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.186317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264469b-eabd-41e1-8756-3f299ae2f9e2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.199180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 411/827] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:14.200262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bab2e-f592-4395-a597-9cb7da7c4c25 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.200620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bab2e-f592-4395-a597-9cb7da7c4c25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.200949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bab2e-f592-4395-a597-9cb7da7c4c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.210337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.222465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-414bab2e-f592-4395-a597-9cb7da7c4c25 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:14.223715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-414bab2e-f592-4395-a597-9cb7da7c4c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:14.256610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18f90b-d394-44c3-acb0-54e23c249f84 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.289842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 412/828] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:14.291090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.291317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.291430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.291653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.291919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.292200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.292472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.293116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:14.293416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.294923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.309075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:14.310242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:14.317793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 417/829] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:14.318446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.370475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.383735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 413/830] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:14.396138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.432917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da3b5-42a8-4650-b36e-fa53f206123a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.475922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.476546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.476820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.477084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.484588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.486330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.486976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:14.500558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:14.501483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:14.502344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:14.509121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 418/831] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:14.510143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.531418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb6f15-eea4-4b13-952b-1939e34f4d14 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.569417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.570061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.570339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.570615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.577803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.579288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:14.590607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:14.591536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 414/832] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:14.597381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.616394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258263-e15d-454c-9371-8748deb0c6e0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.619449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.654516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.655052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.655348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.655612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.656300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:14.656597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.658015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.669694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 419/833] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:14.670340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.696415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763bdbc-171d-409b-bc7c-551bbe1d59b6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.721322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.732790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.733317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.733589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.733858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.734439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.735865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:14.745009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:14.745977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:14.746801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 415/834] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:14.747613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.774670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717413ca-8d29-42a3-a4a1-a45c05c7e9a9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.809041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.809647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.809952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.810224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.811337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:14.811646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.813078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.824303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 420/835] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:14.825064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.849055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7f34-e551-4635-a3e4-b4d25aab01c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.854683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.883477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.884100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.884369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.884633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.895253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:14.900486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:14.901481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 416/836] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:14.902729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:14.932594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efbbf-edde-41cd-a762-e47332e5335f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:14.951842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:14.967404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:14.968061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:14.968333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:14.968598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/837c4c6e2f1743eabe53bf75e01bab1c/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:14.982461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=837c4c6e2f1743eabe53bf75e01bab1c, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:14.983920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:14.997404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 421/837] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:14 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/837c4c6e2f1743eabe53bf75e01bab1c/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:11:14.998210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.014045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd1df-46c9-49f0-8831-4a38643c542b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.058441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.059074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.059370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.060153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.060852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.061153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.062579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.072933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 417/838] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:15.072933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.091108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:15.121064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e4c5-1b35-45b0-a88c-5351b18bd512 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.164747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.165365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.165641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.165918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.166657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.166964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.168435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.175043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 422/839] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:14 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:15.175799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.208674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76c8c-de5a-4640-abb5-9f7a8f52d749 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.224783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:15.249974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.250599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.250877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.251149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.251862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.252162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.253575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.264231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 418/840] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:15.269604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.320219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1682-c62b-46f6-bd3e-b0f11debbe57 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.360970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.361592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.361872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.362147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.362792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.363083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.364491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.369453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 423/841] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:15.399088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836552-6eda-46db-8c33-b3ccc1d30313 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.442487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.443139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.443441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.443704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.456021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.457518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:15.476968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:15.477955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:15.478826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:15.478826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:15.478826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:15.478826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 419/842] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:15.485372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.490026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:15.598382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d203-6b99-43c0-8616-1ccfb81e5082 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.634321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.635372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.636002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.636481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.637315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.637825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.639433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.651774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 424/843] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:15.657772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.688638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:15.767428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcffb-db5e-442d-9e23-531d41f3eee1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.802772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.803815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.804310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.804781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.812679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.814348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:15.825874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:15.826971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 05:11:15.827927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:15.830421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 420/844] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:15.836541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:15.903990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:15.945077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf5805-7e5e-4b7c-96a5-1dfcd795eea8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:15.984074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:15.984687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:15.984960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:15.985225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:15.985954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:15.986251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:15.987711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:16.006095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 425/845] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Sep 2 05:11:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:16.011810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:16.103966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:16.120948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9276-f886-475a-87e5-cb8ffd3fd926 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:16.155715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:16.156707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:16.157180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:16.157637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:16.225519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:16.227346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:16.311875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:16.328503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 421/846] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:16.334534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:16.443320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7aafb-37cc-4bd0-bf4b-8c470c059109 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:16.465188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:16.481751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:16.482548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:16.482949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:16.483284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:16.494400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:16.495943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:16.510769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:16.511774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:16.512657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:16.512657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:16.512657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:16.512657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 426/847] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:16.518195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:16.626184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d18d-73cc-4250-8ec6-36a7fd4f659b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:16.661218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:16.661829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:16.662106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:16.662374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:16.663015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:16.663341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:16.664722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:16.676760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 422/848] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:16.681992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:16.784222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1e8ac-5052-4743-a625-d5d6f613d8fe None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:16.824375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:16.825397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:16.825891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:16.826378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:16.833501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:16.835159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:16.846798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:16.847725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:16.848661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:16.851015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 427/849] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:16.859227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:16.904951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:16.960583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469715f-19ea-425c-b612-6d99522648b3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:16.998207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:16.998824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:16.999100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:16.999408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.000110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:17.000412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.001859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95ca52-0a0d-4767-a71d-423bcc873122 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.015475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 423/850] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:17.021134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.023484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddcb7-8b90-4d66-b995-3af611c7c7ec None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.023997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddcb7-8b90-4d66-b995-3af611c7c7ec None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.024658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddcb7-8b90-4d66-b995-3af611c7c7ec None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.027334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 424/851] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:17.032986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c056-0c1c-46f6-b5c7-42582368a886 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.033838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c056-0c1c-46f6-b5c7-42582368a886 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.034362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c056-0c1c-46f6-b5c7-42582368a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.057916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:17.058252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-82c4c056-0c1c-46f6-b5c7-42582368a886 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:17.060525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-82c4c056-0c1c-46f6-b5c7-42582368a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:17.146189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251d0b-ebe1-4438-80f0-c4efd4016894 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.150534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 425/852] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:17.182301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.183270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.183740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.184178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.185072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8c7c13d179cf442999070e1e0d1cf89b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:17.185575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.187167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347b4a-4b75-4d33-955e-397bca7f57f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.194022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 428/853] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/role_assignments?user.id=8c7c13d179cf442999070e1e0d1cf89b&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:17.204522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef84f1-f76b-44bf-971e-7144a7f53d82 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.204804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef84f1-f76b-44bf-971e-7144a7f53d82 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.205078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef84f1-f76b-44bf-971e-7144a7f53d82 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.206753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 426/854] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:17.212566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a5d2-ed8e-4b31-9733-6870d9aec232 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.212855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a5d2-ed8e-4b31-9733-6870d9aec232 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.213125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a5d2-ed8e-4b31-9733-6870d9aec232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.232836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d783a5d2-ed8e-4b31-9733-6870d9aec232 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:17.234228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d783a5d2-ed8e-4b31-9733-6870d9aec232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:17.313010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 429/855] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:17.429868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef84f1-f76b-44bf-971e-7144a7f53d82 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.432213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e528-6878-4577-85b1-6fb0cb31ec2a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.432495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e528-6878-4577-85b1-6fb0cb31ec2a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.432812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e528-6878-4577-85b1-6fb0cb31ec2a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.434385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 430/856] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:17.440497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.440783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.441064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.472013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:17.473329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:17.478794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:17.498781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:17.550578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 431/857] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:17.550857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef84f1-f76b-44bf-971e-7144a7f53d82 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.578734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.587505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.588149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.588423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.588689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.599813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:17.605213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:17.606135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:17.606951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 427/858] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:17.612452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.717433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a97a-affc-4828-a615-0f868af5b992 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.718298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:17.725478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9efbc-fec8-4499-82ab-d01350a13e7a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.764083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f36d32-9f75-461e-b122-796c532940de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.764973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f36d32-9f75-461e-b122-796c532940de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.765389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f36d32-9f75-461e-b122-796c532940de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.765821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f36d32-9f75-461e-b122-796c532940de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.766370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.766713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f36d32-9f75-461e-b122-796c532940de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.767171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.767563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.767925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.768692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:17.768851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f36d32-9f75-461e-b122-796c532940de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.769179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.771121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-14f36d32-9f75-461e-b122-796c532940de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:17.779864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:17.780813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:17.781688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:17.782414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 428/859] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:17.788998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 432/860] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:17.789664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.789866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f36d32-9f75-461e-b122-796c532940de None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.821306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:17.909550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f36d32-9f75-461e-b122-796c532940de None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.920731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93219a73-28c1-4de8-b6fb-709ed16b5359 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:17.948001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.948615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.948959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.949225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.949792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:17.950097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.951717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.957154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 433/861] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:17.957993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:17.963915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:17.965375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:17.965657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:17.965927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:17.979138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:17.980618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:17.996196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:17.997136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:17.998752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:17.998752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:17.998752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:17.998752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 429/862] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:18.003367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:18.017457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:18.049139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:18.065111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee9ed-9040-45de-90ac-c49c61391db9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.098725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.099416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.099700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.099975 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.100656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.102032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:18.116355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfffb-ab17-45c0-b2d4-ccceb78ae81f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.118885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 434/863] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:17 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:18.128760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:18.186334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.187281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.187709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.188124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.189191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:18.189798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.191421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:18.199342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 430/864] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:18.297137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f669-be5d-4bb5-ac52-5efc08fb05d3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.337877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.338763 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.339189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.339630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.340434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:18.340908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.343518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:18.358413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 435/865] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:18.364266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:18.444233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:18.479104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a16c3-aefd-4bb4-9670-625f9a3ba80d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.516506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.517156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.517433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.517702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.525762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.527308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:18.539707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:18.540687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:18.542021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 431/866] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:18.547603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:18.552832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:18.658086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917eacf-9e56-49a0-a7f0-beb5d0435abd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.693889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.694918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.695448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.695917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.696843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:18.697362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.699005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:18.717703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 436/867] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:18.727242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:18.835417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f632a-f4e9-46e1-8b87-2669b4d2260d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:18.865010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:18.871810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:18.872444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:18.872926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:18.873845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:18.946590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:18.948003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3f30-99e2-413e-9f7a-6918be3e183e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.053140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 432/868] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:18 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:19.058797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.128006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.168474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0456-5ac9-4114-9bc7-5842a49398d9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.203915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.204888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.205494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.205968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.217145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.218908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.228549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8debe-30f1-45ab-b9cb-33d3176ef093 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.228849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8debe-30f1-45ab-b9cb-33d3176ef093 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.229087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8debe-30f1-45ab-b9cb-33d3176ef093 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.230671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 433/869] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:19.235939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.236251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:19.236498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:19.237364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:19.238245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:19.238245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:19.238245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:19.238412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.240386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 437/870] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:19.251325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.255941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:19.257111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:19.284226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.347465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 434/871] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:19.382051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d2aa-41e6-4aca-aaf9-8d100f145487 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.396593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.417930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.418571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.418856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.419124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.419915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:19.420298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.421658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.433914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 438/872] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:19.440076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.557434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3968b-3032-4970-9d4e-a8fb5597797d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.593132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.593765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.594038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.594302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.601149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.602603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.608099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:19.615424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:19.616522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:19.618020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 435/873] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:19.625448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.654867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.718046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d3b4-5e63-4d61-a9f3-0f09c99287a6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.753576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.754332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.754670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.754999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.755689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.757113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.765205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafaf88-d5e3-4280-ba20-adf35bd8239e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:19.766641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:19.768617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:19.770580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:19.775343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 439/874] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:19.775343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.810733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.811383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.811818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.812091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.813579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:19.813894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.815396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.818318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.830654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 436/875] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:19.836355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.896166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053321-17ce-4409-b2b4-c4ed88150e61 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:19.937360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:19.944716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:19.945457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:19.945831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:19.946198 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:19.946927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:19.947884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:19.949665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:19.959246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 440/876] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:19.961957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:19.967594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0933-f308-45d7-aac0-d0d34c697f51 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:20.003600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:20.004242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.004560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.004826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.005542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=837c4c6e2f1743eabe53bf75e01bab1c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:20.005896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:20.007357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeca94-38b1-4724-bf5f-78f8e0b6dfd8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:20.014397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 437/877] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/role_assignments?user.id=837c4c6e2f1743eabe53bf75e01bab1c&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:20.083783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a109-5e7d-4cf0-bc4a-b540b8aaca6a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:20.100074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:20.109359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b16d-dea6-46a1-b1d4-770d2b96030b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.109705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b16d-dea6-46a1-b1d4-770d2b96030b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.109896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b16d-dea6-46a1-b1d4-770d2b96030b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.111742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 438/878] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:20.117502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a0cb-f261-4f25-8b68-0d16c219e36d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.118180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a0cb-f261-4f25-8b68-0d16c219e36d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.118451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227a0cb-f261-4f25-8b68-0d16c219e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.123072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:20.123775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.124055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.124329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.124967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:20.125595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:20.128042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee486-b3cf-4e9f-9d8f-a0e9d0cf4465 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:20.136212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 441/879] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:20.144797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8227a0cb-f261-4f25-8b68-0d16c219e36d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:20.146469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8227a0cb-f261-4f25-8b68-0d16c219e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:20.229443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 439/880] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:20.298453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b59714-90e1-4f38-922e-f8e8b90434e9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.299089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b59714-90e1-4f38-922e-f8e8b90434e9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.299649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b59714-90e1-4f38-922e-f8e8b90434e9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.301175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 442/881] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:20.306306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.306587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.306865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.325453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:20.326671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:20.402121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 440/882] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:20.512485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b59714-90e1-4f38-922e-f8e8b90434e9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:20.624325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b59714-90e1-4f38-922e-f8e8b90434e9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:20.661298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:20.662320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.662883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.663389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.664271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:20.665855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:20.669276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:20.672971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:20.683846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 443/883] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:20 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:20.794360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7c92-c9d1-47cb-bb78-8e6c60d6a6ac None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:20.839319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:20.839956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:20.840231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:20.840497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:20.841079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:20.842545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:20.851387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:20.852335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:20.853142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 441/884] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:20.860309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:20.893048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:20.976768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0edcb-6ae0-4481-9574-337f189c86c3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:21.011961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:21.013549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:21.013730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:21.013985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:21.014621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:21.014921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:21.016390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:21.021718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 444/885] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:21.027243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:21.090559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:21.138756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b667-1a83-455c-a7ca-a252a12b666b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:21.175145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:21.175706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:21.175988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:21.176253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:21.176889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:21.177185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:21.178556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:21.183910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 442/886] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:21.189969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:21.292115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:21.305130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c600a-bb2d-483a-a526-f863a94cecac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:21.340179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:21.341136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:21.341673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:21.342136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:21.343041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] RBAC: Adding query filter params (interface=public, service_id=90d20fbd7e494b629286fac146ebf8e2, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:21.343586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:21.345136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1421-8a0c-4c71-a47f-e412b3569196 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:21.351180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 445/887] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:21 2022] GET /identity/v3/endpoints?service_id=90d20fbd7e494b629286fac146ebf8e2&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:21.356916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:21.455101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6464-1620-492a-a7ae-c2bd1f1f4f0d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:21.481634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:21.490380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:21.491033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:21.491337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:21.491604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:21.492301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:21.493994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0fd9-2c1f-42ef-a095-202abdd60fd5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:21.500101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 443/888] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:21 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:11:22.100470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a1184-5b7b-452d-95d6-2e40c33229b0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.101495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a1184-5b7b-452d-95d6-2e40c33229b0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.102009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a1184-5b7b-452d-95d6-2e40c33229b0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.103827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 446/889] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:22.109396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.110215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.110687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.120686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73a4d-6e0e-4bbe-9c6d-2215fb9b5316 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.121266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73a4d-6e0e-4bbe-9c6d-2215fb9b5316 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.121735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73a4d-6e0e-4bbe-9c6d-2215fb9b5316 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.123714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 447/890] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:22.132153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:22.133660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:22.134155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.134445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.134720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.154168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:22.155810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:22.207483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 444/891] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:22.243312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 448/892] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:22.474027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:22.526179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:22.587317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bab772-68c2-42b9-a6fe-37a76041bf8a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:22.613122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:22.617152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:22.628453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:22.629465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.629977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.630436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.634717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac94cc-367a-4326-964c-8c6b29659303 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:22.641836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:22.647179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:22.648116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:22.648929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:22.656196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 445/893] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:22.657282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:22.672934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:22.673559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.673835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.674107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.674754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:22.676358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834470b0-154d-4fcf-9b39-9a293b908e7d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:22.694164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 449/894] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:22 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:22.749308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bc8a-7ba5-494d-97c2-bf9208064cbf None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.749595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bc8a-7ba5-494d-97c2-bf9208064cbf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.749878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0bc8a-7ba5-494d-97c2-bf9208064cbf None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.752316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 450/895] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:22.757151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.757438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.757714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.776876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:22.778110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:22.795230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2054517-75f9-4c43-9f35-3ebf975733ce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:22.851170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:22.851846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:22.852120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:22.852382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:22.853065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:22.853369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:22.854745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:22.856406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 451/896] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:22.865850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 446/897] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:22.872126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:22.957920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:22.989901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29176f8-810b-4977-8f2e-2083fa8a738a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.026627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.027766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.028486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.029115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.042355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.044102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:23.059954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:23.061420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:23.062332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:23.062332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:23.062332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:23.064274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 452/898] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:23.071245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.114513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.139069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.195270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a5f1-5d7b-4be1-b865-aa8f71932b04 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.238729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.239371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.239644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.239911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.240544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:23.240838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.242205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.260475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 447/899] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:23.262551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.264671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db5c1-f482-48b8-acbd-1dbefa5eaf84 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.297149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.306845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.307740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.308107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.308571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.309219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.310741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:23.320211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:23.321242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:23.322115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 453/900] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:23.327878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.391695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.396185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6ebfc-7fa7-4aa5-90fb-df9a708a7d34 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.434503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.435172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.435470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.435737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.439378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c7eb-52bf-4da8-a905-0e0e76ff82ab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.442968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.444442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-84393af1-07a4-4c61-a42c-083bdeeab693 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:23.455911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:23.456891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:23.457835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 448/901] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:23.458427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b660-8729-4fb2-8413-b5543cf15826 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.458427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b660-8729-4fb2-8413-b5543cf15826 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.458912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b660-8729-4fb2-8413-b5543cf15826 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.465639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 449/902] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:23.465639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b660-8729-4fb2-8413-b5543cf15826 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.488584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.489220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.489495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.489756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.490379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:23.490783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.492280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd579ed-a613-484f-bf8a-d02220b0e349 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.502707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 454/903] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:23.503970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.504254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.504526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.525846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:23.527044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:23.570717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b660-8729-4fb2-8413-b5543cf15826 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.579714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.603350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 455/904] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:23.603350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.614828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.616031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.616461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.617228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.618764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:23.619276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.621461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.644758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 450/905] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:23.650001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.671914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.740496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11828e8-4127-4694-8fd8-0a673c013d9e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.760326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ded73-bc93-4c3a-8653-949324711a38 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.788859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.789583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.789923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.790294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.791081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:23.791643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.793068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.800354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 456/906] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:23.803385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.804006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.804280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.804638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.806268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:23.865955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.894791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.896563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.915752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:23.922169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f327-0b78-437c-b9fd-717a60b5aee7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:23.957014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:23.957616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:23.957889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:23.958152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:23.958846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] RBAC: Adding query filter params (interface=public, service_id=90a0fa4892ce49848b1e37154c96ac10, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:23.959146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:23.960532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:23.965454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 457/907] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/endpoints?service_id=90a0fa4892ce49848b1e37154c96ac10&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:23.966217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.008332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 451/908] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 05:11:24.009521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.075428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d469d-5034-4989-8c80-d2019a656849 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.088353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.111313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.111977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.112252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.112520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.113096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.114483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.117864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd9fb7-0ed5-49d5-8a2f-ee45c5f85572 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:24.123441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:24.124469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 05:11:24.125312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:24.129356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 458/909] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:24.130181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.139131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.158345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.158975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.159249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.159535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.160139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.161696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.168214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 452/910] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:11:24.168992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.254944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bab-62c3-4f31-8aa4-4f4c40fa2429 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.295567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.296871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.297438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.297879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.311292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.313210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.320527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8605c-72cd-4013-b8be-28067a0e8a14 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:24.330366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:24.331385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:24.332274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:24.332274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:24.332274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:24.332274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 459/911] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:24.338743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.362127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.362747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.363023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.364465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.364465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:24.364465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.367263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.374797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 453/912] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:24.376129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.380875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.436391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.470726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e2b74-015f-4533-8526-5e1c6bcfa495 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.495896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db887e9-5e30-491e-b041-4e70165f6399 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.514993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.519218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.519218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.519218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.519218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:24.519218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.519560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.536846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 460/913] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:24.542283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.545996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.546613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.546885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.547151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.548575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:24.548575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.549461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.555025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 454/914] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:24.560260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.647476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.667570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ae6d-104c-4f74-8b60-0fe187d331e0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.667764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2188df4-2e32-4bb2-b359-61da99dacefe None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.678441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:24.703607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.704306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.704588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.704855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.705613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.707088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59adad7-ab91-479d-a0f2-df62b35dbec9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.708005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.708805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.709225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.709654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.717772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.719445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.730099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 455/915] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:24.735251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:24.736371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:24.737296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 461/916] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:24.737787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ee65-ed8c-4bb0-ae68-fe62c49214f0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.738333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ee65-ed8c-4bb0-ae68-fe62c49214f0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.738667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ee65-ed8c-4bb0-ae68-fe62c49214f0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.739993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:24.745679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 456/917] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:24.746301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402700-e190-4426-9621-2325c4b3d85f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.746592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402700-e190-4426-9621-2325c4b3d85f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.746858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402700-e190-4426-9621-2325c4b3d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.768782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-68402700-e190-4426-9621-2325c4b3d85f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:24.769987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-68402700-e190-4426-9621-2325c4b3d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:24.863079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff700b5-4e60-47b2-bd70-8f81d8a5b46c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:24.863706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 457/918] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:24.900003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:24.900970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:24.901462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:24.901737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:24.902429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:24.902760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:24.904525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:24.916839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 462/919] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:24.922641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402700-e190-4426-9621-2325c4b3d85f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.024513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:25.037398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402700-e190-4426-9621-2325c4b3d85f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.074620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.075243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.075517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.075951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.076772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] RBAC: Adding query filter params (role.id=8d1632b435e2456780e0553464318fce, scope.project.id=1920309f691847578cad8f735480b42c, user.id=837c4c6e2f1743eabe53bf75e01bab1c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:25.077073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.078506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.084545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 458/920] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:24 2022] GET /identity/v3/role_assignments?user.id=837c4c6e2f1743eabe53bf75e01bab1c&scope.project.id=1920309f691847578cad8f735480b42c&role.id=8d1632b435e2456780e0553464318fce => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:25.126693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.143559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:25.246383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f39f13-3f83-4db6-a746-e096c805da91 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.282408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.283170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.283386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.283627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.284215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.285574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:25.294705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:25.296210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:25.297028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 463/921] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:25.303803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.408730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c01d-7100-4108-9dba-8f602f315326 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.443004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.443635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.443907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.444172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.444792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:25.445085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.446448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.451781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 459/922] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:25.457311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.539269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:25.571608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e30ba-02a4-4a2e-b6ef-e5defc525558 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.605026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490021-d597-4299-92e1-ae614409517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.605634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490021-d597-4299-92e1-ae614409517f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.605906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490021-d597-4299-92e1-ae614409517f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.606170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490021-d597-4299-92e1-ae614409517f None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.606792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490021-d597-4299-92e1-ae614409517f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:25.607134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490021-d597-4299-92e1-ae614409517f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.608527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490021-d597-4299-92e1-ae614409517f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.613794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 464/923] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:25.619864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.679598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:25.721882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093725-fe08-44d0-808c-abcd4a36f876 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.756584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.757251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.757528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.757798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.758543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] RBAC: Adding query filter params (interface=public, service_id=b5be6526fabb4464bfd134eafb59a413, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:25.758851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.760256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ef7c-84c9-40bb-987e-9b2c8716d5ec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.772331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 460/924] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:25 2022] GET /identity/v3/endpoints?service_id=b5be6526fabb4464bfd134eafb59a413&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:25.773944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490021-d597-4299-92e1-ae614409517f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:25.875333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490021-d597-4299-92e1-ae614409517f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:25.914172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:25.914789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:25.915110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:25.915429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:25.916037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:25.917393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83facabb-4c46-49c6-91ab-13d74c883dce None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:25.919160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:25.928770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 465/925] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:25 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:11:26.177943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4202-1e6e-406c-adb0-f39c7eb59e2d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.178212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4202-1e6e-406c-adb0-f39c7eb59e2d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.178391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4202-1e6e-406c-adb0-f39c7eb59e2d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.180141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 461/926] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:26.185259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f483e-caab-483f-8434-065235b1e975 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.185612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f483e-caab-483f-8434-065235b1e975 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.185949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f483e-caab-483f-8434-065235b1e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.205012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-442f483e-caab-483f-8434-065235b1e975 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:26.206221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-442f483e-caab-483f-8434-065235b1e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:26.275279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 466/927] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:26.543405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc4202-1e6e-406c-adb0-f39c7eb59e2d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:26.629804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:26.649505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc4202-1e6e-406c-adb0-f39c7eb59e2d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:26.684216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:26.684844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.685394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.685663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.686245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:26.687649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bb027ef0-1dc3-45c2-ab61-ce7377e67563 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:26.696656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:26.697673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:26.698630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 462/928] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Sep 2 05:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:26.703801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f483e-caab-483f-8434-065235b1e975 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:26.805970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f483e-caab-483f-8434-065235b1e975 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:26.835322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:26.841496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:26.842599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.843117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.843732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.844609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:26.845251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:26.846624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:26.851908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 467/929] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:26.853839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851feb-43af-4079-9c54-e918f89824e5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.854121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851feb-43af-4079-9c54-e918f89824e5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.854393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851feb-43af-4079-9c54-e918f89824e5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.855971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 463/930] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:26.857377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:26.861122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.861400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.861666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.880804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:26.881977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:26.958393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5eff-899d-47f4-aee8-662b62e9db64 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:26.960329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 464/931] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:26.994008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:26.994624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:26.994903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:26.995170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:26.995824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:26.996122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:26.997609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0567277-d393-47c7-87df-bd8858c8d5a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.003599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 468/932] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:27.011779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.095069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:27.095555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f20d7-a8ff-428c-b4f6-236db9539d8d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.096083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f20d7-a8ff-428c-b4f6-236db9539d8d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.096578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f20d7-a8ff-428c-b4f6-236db9539d8d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.098377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 469/933] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:27.103395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.103916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.104770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.117839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9cab-233f-484a-aa0d-19140fb66d73 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.126750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:27.128650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:27.156365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.157320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.157827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.158307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.159179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:27.160797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.185005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 465/934] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:27.195655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:27.219310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 470/935] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:27.252372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.372531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22322e-9058-400e-a7f4-b2953e867350 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.408890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.409532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.409782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.410051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.410709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:27.412311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.414932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING keystone.server.flask.common [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 05:11:27.418360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:27.436621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.sql.core [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 05:11:27.436621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 05:11:27.436621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [parameters: {'id': 'c8ba2eb819824e26ba45254bf65d7087', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 05:11:27.436621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8ba2eb819824e26ba45254bf65d7087.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8ba2eb819824e26ba45254bf65d7087. Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:11:27.454139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 02 05:11:27.455005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application yield resource Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise self.value Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application session.commit() Sep 02 05:11:27.456083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.flush() Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application compat.raise_( Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 05:11:27.456962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 05:11:27.457867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:11:27.458652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [parameters: {'id': 'c8ba2eb819824e26ba45254bf65d7087', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.460832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:27.462651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8ba2eb819824e26ba45254bf65d7087. Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.464755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 466/936] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Sep 2 05:11:27 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:27.474891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.518625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.600920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f826d-0506-4e03-b2c6-9990acb82c59 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.637520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fd95-26d6-422d-a37b-866e3e0c2c47 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.640404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.641055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.641330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.641596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.648938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:27.650395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:27.663466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:27.664432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:27.665313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 471/937] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:27.672292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.684335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.685387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.685883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.686359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.699136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:27.705933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:27.707735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:27.709282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:27.712736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 467/938] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:27.719310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:27.724067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:27.782998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:27.785834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b1d8-d2a9-4081-8edf-f8965c0f523b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.823623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.824081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.824360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.824634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.825295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:27.825664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:27.827379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.846379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 472/939] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:27.848489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d309b4-8dfc-4bf2-a3f7-343afe15b864 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:27.899967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:27.900505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:27.900778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:27.901043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:27.901719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:27.902015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:27.904581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b0c9-b3da-44da-8bea-0aa20e50033a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:27.918156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 468/940] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:27.924658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.027841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d3f1-c9ff-41cc-a778-b078505d041c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.028496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d3f1-c9ff-41cc-a778-b078505d041c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.029061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d3f1-c9ff-41cc-a778-b078505d041c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.030747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 469/941] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:28.037246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.037816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.038096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.047645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631ab5-a1d3-4622-a489-88c85b91d921 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.050483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.064332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:28.066842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:28.090388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.091060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.091434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.092585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.107583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.109095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:28.125215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:28.126229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:28.127842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:28.127842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:28.127842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:28.127842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 473/942] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:28.132473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.165430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 470/943] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:28.254308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0a0ac-5470-41b5-91f4-ef2c2d9136e4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.295110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.295770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.296047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.296324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.297047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:28.297355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.298741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.314736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 474/944] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:28.320896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.375134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.449394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2e8bc-854e-451d-9750-5959dd95bdc2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.478597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.497697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.498664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.499233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.499882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.506342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.509668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.511166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:28.528226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:28.529239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:28.530164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 471/945] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:28.537273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.617348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18ee4-8a74-414e-a409-d103b1714957 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.653157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a400-3afc-4197-88cf-cb1662ff925c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.654720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.655474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.656224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.656622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.656900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.657410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.659022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:28.669844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:28.672189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:28.674052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 475/946] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:28.684417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.690516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.691131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.691451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.691718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.692448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:28.692746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.694184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.713602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 472/947] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:28.719783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.779147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.800456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e297-fcef-48b6-ace5-c295cef07152 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.836403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.837010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.837292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.837564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.838200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:28.838532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.840065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.845926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 476/948] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:28.851702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.857224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b03a0-c52a-4341-b3bf-43fb9ff0d9fb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:28.896002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:28.896797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:28.897162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:28.897522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:28.909219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:28.910986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:28.927587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:28.928647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:28.929543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:28.929543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:28.929543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:28.930187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 473/949] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:28.937109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:28.953955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:28.983504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc625350-670a-4f98-aca1-8c5c3455eb3a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.019295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.019916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.020197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.020470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.021107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:29.021412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.022790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.028398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 477/950] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:29.035222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:29.050510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:29.059826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2bee-6845-4a8d-9ac8-bda192d4e454 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.100525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.101368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.101852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.102194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.103364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:29.103788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.105652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.123416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 474/951] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:29.126505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:29.158550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6cb99-253e-44ce-82ba-0ee2abf71342 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.199705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.201019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.201574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.202089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.202972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.204692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.205171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:29.237244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 478/952] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:29.256980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770b41-bc2d-4074-81b3-ea35ba789e55 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.304246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.304964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.305403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.305677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.313823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.315388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-160318f2-78d3-44f3-8516-9eb211a29392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:29.328709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:29.329825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:29.330814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 475/953] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:29.337918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:29.345833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d457a8-e411-471e-8858-3ad2c63095d6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.346167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d457a8-e411-471e-8858-3ad2c63095d6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.346370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d457a8-e411-471e-8858-3ad2c63095d6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.349113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 476/954] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:29.353579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.353909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.354183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.375369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:29.376605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:29.412602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:29.465386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 477/955] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:29.476344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2d3d-4ee9-47eb-befc-a27ecbb5a172 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.512851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.513444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.513749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.514078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.514849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:29.515158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.518767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.532014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 479/956] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:29.540504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:29.601728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:29.649284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735c5c7-4a1b-44b4-99c6-ee7f7beead17 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.685090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.685714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.685997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.686192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/837c4c6e2f1743eabe53bf75e01bab1c/roles/8d1632b435e2456780e0553464318fce` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.688275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=837c4c6e2f1743eabe53bf75e01bab1c, role_id=8d1632b435e2456780e0553464318fce)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.689724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.705191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 478/957] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:29 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/837c4c6e2f1743eabe53bf75e01bab1c/roles/8d1632b435e2456780e0553464318fce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:11:29.777194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:29.884491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ce06-8725-42ff-a359-0ff8fd32a77a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:29.911306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:29.928693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:29.929349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:29.929631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:29.929901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:29.930518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:29.931934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-46353e34-b5fe-41d4-83bb-6dd12bb1e5d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:29.941469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:29.942575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:29.943479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 480/958] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:29.948521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:30.027043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ecec4-e4da-4e28-810e-b66eba07ecec None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.027422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ecec4-e4da-4e28-810e-b66eba07ecec None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.027653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ecec4-e4da-4e28-810e-b66eba07ecec None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.029106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 481/959] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:30.034167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.034519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.034859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.053902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:30.055175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:30.069609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cfca-6348-4cdd-8293-015e40836dd6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:30.094363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:30.119174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:30.120720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.121173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.121834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.122725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:30.123421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:30.124835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:30.132557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 479/960] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:30.137417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 482/961] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:30.140262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:30.246753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147caf33-a269-4023-8c83-6e60d21c6f6b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:30.288354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:30.289300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.289782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.290252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.291077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:30.291630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:30.293201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:30.298303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 480/962] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:30.401350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:30.510224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1611-cd49-4b62-9c9b-f075d9a5c989 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:30.528411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:30.546986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:30.547548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.547821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.548085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.548721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:30.550211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:30.552868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING keystone.server.flask.common [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 05:11:30.565750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.sql.core [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 05:11:30.565750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 05:11:30.565750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [parameters: {'user_id': 'f41959cf0ed441c98da44f51824d8e41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 05:11:30.565750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Sep 02 05:11:30.572608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:11:30.573503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application yield resource Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise self.value Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application session.commit() Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 05:11:30.574438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.flush() Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application compat.raise_( Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 05:11:30.575958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 05:11:30.576843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 05:11:30.577663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f41959cf0ed441c98da44f51824d8e41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:30.578583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 02 05:11:30.580776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:30.582961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 483/963] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Sep 2 05:11:30 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:30.592034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:30.630703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:30.687946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb173-4e1f-4bc8-aea2-88c4ad02b525 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:30.723159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:30.723840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.724166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.724431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.732289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:30.733883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b76bd233-6a17-4e0a-9fd4-2e4359a0f07d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:30.745535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:30.747737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:30.749904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 481/964] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:30.754288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:30.858002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e530dac-bf6e-4b17-8fc4-881c631603fd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:30.893121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:30.893902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:30.894059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:30.894243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:30.894948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:30.895273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:30.896977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d653-5533-4d70-8cad-ecb0e08ed1e8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:30.939007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 484/965] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Sep 2 05:11:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:31.281022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b1b23-00f1-4797-b835-f896902ab2c9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.281432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b1b23-00f1-4797-b835-f896902ab2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.281629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b1b23-00f1-4797-b835-f896902ab2c9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.282915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 482/966] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:31.288367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872475-0900-4c7d-8b35-1f18772c3175 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.288660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872475-0900-4c7d-8b35-1f18772c3175 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.288897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872475-0900-4c7d-8b35-1f18772c3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.308214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d7872475-0900-4c7d-8b35-1f18772c3175 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:31.309735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d7872475-0900-4c7d-8b35-1f18772c3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:31.343168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:31.386277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 485/967] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:31.649210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b1b23-00f1-4797-b835-f896902ab2c9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:31.745637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d229e43-e421-4306-b424-6673407a45b1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.745928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d229e43-e421-4306-b424-6673407a45b1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.746221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d229e43-e421-4306-b424-6673407a45b1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.747848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 486/968] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:31.752912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.753216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.753468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.757466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b1b23-00f1-4797-b835-f896902ab2c9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:31.765256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:31.772264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:31.773444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:31.795350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:31.795993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.796268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.796535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.797117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:31.798953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:31.808054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:31.809114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:31.810023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 483/969] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:31.815238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:31.857006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 487/970] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:31.918799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9c626-a125-41c8-a054-04392317b46c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:31.954174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:31.954804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:31.955960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:31.955960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:31.956131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:31.961352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:31.961352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:31.966298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 484/971] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:31.971952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.070859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.075783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ce37-e381-4898-b358-9233f131a8b4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.110102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.110713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.110995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.111291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.111931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:32.112230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.113625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.118652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.118990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 488/972] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:32.124803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.163939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.228524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451019c-0dee-4f97-be3b-43c88abf67c7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.249310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13b21-3b09-4d41-bee7-b3791be6dc7a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.263996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.264586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.264868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.265161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.265841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] RBAC: Adding query filter params (interface=admin, service_id=b5be6526fabb4464bfd134eafb59a413, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:32.266148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.267664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.272992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 489/973] 10.222.0.26 () {56 vars in 1249 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/endpoints?service_id=b5be6526fabb4464bfd134eafb59a413&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:32.278287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.287775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.288836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.289307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.289746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.302945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:32.307076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-61b6e60a-62db-4c23-a359-d08670402102 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:32.308281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:32.309624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:32.310655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 485/974] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:32.311416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e28-81e2-4dbb-815c-3cac90b76abb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.311416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e28-81e2-4dbb-815c-3cac90b76abb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.311917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e28-81e2-4dbb-815c-3cac90b76abb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.313002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 486/975] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:32.318199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02e28-81e2-4dbb-815c-3cac90b76abb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.392745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e87f-691a-42c0-8b93-6b6f8bcaf54b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.422246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.426699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.427352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.427628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.427896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.428585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.429963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf94ac-dc26-43d8-b9ee-315e7f42309e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.430069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02e28-81e2-4dbb-815c-3cac90b76abb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.436295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 490/976] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:11:32.437455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.437740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.438013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.457918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:32.459167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:32.490810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.491372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.491659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.491906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.492890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:32.493188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.494606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.508804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 487/977] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:32.509799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.540300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 491/978] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:32.619707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3ad-e5d2-460d-95c4-dba382011a1f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.656147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.656790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.657065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.657335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.668407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.670203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:32.685060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:32.686253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:32.687795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:32.687795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:32.687795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:32.687795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 488/979] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:32.691974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.715072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.797699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f5f9e-bd2f-4ce4-8aa3-94bc1d5a9bc2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.807321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.819240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.839510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.840129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.840397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.840661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.841375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:32.841734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.843002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.860884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 492/980] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:32.862384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:32.911611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b90f3-77f1-481e-92d0-f45405104dc0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:32.945399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:32.946004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:32.946256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:32.946520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:32.947193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:32.948595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:32.962169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:32.965796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 489/981] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:32 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:11:32.986282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88902c0c-a8c5-46ff-8ee8-fbc0050a5d3a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:33.034646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:33.035656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:33.036086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:33.036507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:33.045798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:33.047589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:33.061168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:33.062219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:33.068064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 493/982] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:11:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:33.070402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:33.150020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:33.186487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79e77-72a2-416d-8164-1ca3bb9f17d1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:33.224576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:33.225185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:33.225432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:33.225722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:33.226451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:33.226748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:33.228277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:33.251717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 490/983] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Sep 2 05:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:33.257230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:33.360205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700a0d-8e05-4857-a8eb-99ad22b6a3a6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:33.395511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:33.396118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:33.396390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:33.396654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:33.400220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:33.476747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:33.478207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:33.584902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 494/984] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:33 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:33.586462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:33.692952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcd519-ba55-4018-83ef-994044eab659 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:33.719694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:33.729728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:33.730354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:33.730621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:33.730883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:33.741455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:33.743221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:33.757564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:33.758502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:33.759800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:33.759800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:33.759800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:33.760219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 491/985] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:33.764464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:33.804600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:33.873166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e2d-df41-4d2c-ba35-0cc81bfaf1ff None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:33.909209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:33.909813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:33.910088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:33.910359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:33.910971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:33.911292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:33.912656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:33.925062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 495/986] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:33.931178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:34.037626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825fbb5-929e-4478-8691-3e3e2fd56cf6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:34.075674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:34.076488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.076760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.077003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.084019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:34.085467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:34.097087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:34.097977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:34.098868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:34.099825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 492/987] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:34.104029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:34.203466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:34.210583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a15eb-9815-4223-bf4f-592d7668fba7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:34.245455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:34.246058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.246326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.246587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.247357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:34.247658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:34.249076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f7cf-d98c-42db-9b8e-4d1507f7f675 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:34.261199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 496/988] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:34.267171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:34.307935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:34.370486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff6e5-360d-4fea-a90c-50cb3222b7ea None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.370776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff6e5-360d-4fea-a90c-50cb3222b7ea None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.371050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff6e5-360d-4fea-a90c-50cb3222b7ea None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.372875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 497/989] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:34.374113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad41a-857d-4665-97a2-9ed1a12d565f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:34.377864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2203-bebc-4e48-acfc-f7fc7b89f30e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.378148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2203-bebc-4e48-acfc-f7fc7b89f30e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.378423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2203-bebc-4e48-acfc-f7fc7b89f30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.396617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b14b2203-bebc-4e48-acfc-f7fc7b89f30e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:34.397810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b14b2203-bebc-4e48-acfc-f7fc7b89f30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:34.410111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:34.410961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.411265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.411537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.412261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] RBAC: Adding query filter params (role.id=8d1632b435e2456780e0553464318fce, scope.project.id=1920309f691847578cad8f735480b42c, user.id=837c4c6e2f1743eabe53bf75e01bab1c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:34.412562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:34.414034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:34.420745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 493/990] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:34 2022] GET /identity/v3/role_assignments?user.id=837c4c6e2f1743eabe53bf75e01bab1c&scope.project.id=1920309f691847578cad8f735480b42c&role.id=8d1632b435e2456780e0553464318fce => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:34.494068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 498/991] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:34.757576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:34.863048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7247-3e91-42c1-9720-0f062a520ccb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:34.864612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:34.883554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45659-4306-464b-a88a-21ce9b90f328 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.884198 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45659-4306-464b-a88a-21ce9b90f328 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.884482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45659-4306-464b-a88a-21ce9b90f328 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.885978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 499/992] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:34.891579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.891863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.892134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.904007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:34.904652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:34.904925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:34.905189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:34.905772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:34.907139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:34.914257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:34.915514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:34.916576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:34.917502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 05:11:34.918347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:34.919829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 494/993] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Sep 2 05:11:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:34.923606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:34.994978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 500/994] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:35.035527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656bc4-622a-4c76-8c7b-21df7b21ff78 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.072254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.072864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.073136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.073403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.074030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:35.074327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.075772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.080948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 495/995] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:35.086579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.104934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:35.187765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0799-62de-4003-bbca-158969a91ba9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.222167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.222779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.223059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.223360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.223989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:35.224286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.225709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.231083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 501/996] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:35.236890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.257902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.273618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:35.347694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:35.353930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5661-02f7-4b2f-a795-9acf3969788e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.366781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52cc4-c1a0-4e31-aa20-a010287bdf72 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.391273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.391882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.392156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.392420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.393073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.394663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.401624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.402266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.402545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.402820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.403474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.404847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.412820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 496/997] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:35.421357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:35.422481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:35.423366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:35.429570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 502/998] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:35.431264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.535726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:35.555847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a68b9-9e95-4506-8206-fa7221ed86b0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.595122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.595762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.596034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.596298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.596930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:35.597221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.598640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.603994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 497/999] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:35.610227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.712062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08249e0-4721-47a8-8231-54bcb10f4c96 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.747805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.748758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.749266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.749737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.750584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:35.751085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.752691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.763242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 503/1000] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:35.764861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.872773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9d85-369a-44c9-9779-0094b5b64210 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:35.911517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:35.912379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:35.912658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:35.912927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:35.913632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] RBAC: Adding query filter params (interface=public, service_id=c87cb0ff3fee4e358bb9fdb810f7e35e, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:35.913937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:35.915441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efe304-2d13-4481-9fd0-4aa75970a4db None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:35.923528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 498/1001] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/endpoints?service_id=c87cb0ff3fee4e358bb9fdb810f7e35e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:35.929412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:35.942257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:36.034131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb54b2-6baa-4441-9102-0770ce7c5409 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:36.067845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:36.068451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:36.068725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:36.068989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:36.069595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:36.070932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61c245-91e7-4209-a50c-67f398576e39 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:36.083506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 504/1002] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:35 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:11:36.383895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb42-ac08-4ed4-9a66-54504ae06437 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:36.384437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb42-ac08-4ed4-9a66-54504ae06437 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:36.384437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb42-ac08-4ed4-9a66-54504ae06437 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:36.385742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 499/1003] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:36.392116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:36.392574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:36.392664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:36.412069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:36.413279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:36.491187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 505/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:36.760082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbbb42-ac08-4ed4-9a66-54504ae06437 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:36.777916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:36.871845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbbb42-ac08-4ed4-9a66-54504ae06437 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:36.908869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:36.909507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:36.909780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:36.910034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:36.910674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:36.912113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:36.921528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:36.922503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:36.924259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 500/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Sep 2 05:11:36 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:36.929046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:36.931560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:37.036834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13977-3118-4f4a-920b-ed833f948f22 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:37.070732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:37.071363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.071639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.071903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.072522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:37.072816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:37.074183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c6fa-fecb-49fb-9c44-45f3bce7873e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:37.083315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 506/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:37.085140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:37.170551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:37.195434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af100c5e-c59c-45ef-8655-1458a40def6d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:37.231106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:37.231958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.232410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.232678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.233303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:37.233598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:37.234970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6480710-0c75-48c3-a4c6-2b87b33ff925 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:37.239810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 501/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:37.349423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b08a-e0f4-4ac4-8311-0b592d0c1eb8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.349614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b08a-e0f4-4ac4-8311-0b592d0c1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.349839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613b08a-e0f4-4ac4-8311-0b592d0c1eb8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.351438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 507/1008] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:37.356993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.357294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.357733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.378085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:37.378731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:37.452245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 502/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:37.714536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613b08a-e0f4-4ac4-8311-0b592d0c1eb8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:37.783904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:37.820605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613b08a-e0f4-4ac4-8311-0b592d0c1eb8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:37.854834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:37.855506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.855783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.856052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.857335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:37.858770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306546-c2d5-4bc0-ae7a-4cec1476c01c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:37.860530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 508/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:37.866171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:37.937543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:37.969220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22e755-1366-4eee-bfa2-11f1168320b9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:37.985056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87268-1299-481b-ab0d-87fff1a11309 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.985337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87268-1299-481b-ab0d-87fff1a11309 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.985597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87268-1299-481b-ab0d-87fff1a11309 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:37.987183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 509/1011] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:37.991728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:37.992015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:37.992289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:38.010938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:38.011187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:38.011793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:38.012077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:38.012193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:38.012361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:38.013144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:38.014573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:38.044253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 503/1012] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:37 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:38.086521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 510/1013] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:38.367136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:38.484613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96e02-4cad-4a6c-a8ed-a687d909f1b3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:38.509061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:38.522736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:38.523555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:38.523932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:38.524299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:38.524987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:38.526462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:38.537583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:38.538914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 05:11:38.539884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:38.547252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 504/1014] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:38.547400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:38.614021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:38.654970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0337f7-1438-4a24-bf31-cf4ee742712a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:38.691475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33f744-c033-4611-af42-689226edee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:38.692098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f744-c033-4611-af42-689226edee72 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:38.692376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f744-c033-4611-af42-689226edee72 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:38.692644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f744-c033-4611-af42-689226edee72 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:38.693279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33f744-c033-4611-af42-689226edee72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:38.693579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33f744-c033-4611-af42-689226edee72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:38.694948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33f744-c033-4611-af42-689226edee72 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:38.704398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 511/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:38.705514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:38.808829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179a42-2d0d-4c8e-b84f-38e7626ed24a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:38.842653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:38.843509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:38.843926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:38.844432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:38.845194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:38.845632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:38.847131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4345b12-a134-4b09-84cf-4b45777dba68 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:38.856932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 505/1016] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Sep 2 05:11:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:38.858445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33f744-c033-4611-af42-689226edee72 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:38.961410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33f744-c033-4611-af42-689226edee72 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:38.990230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:38.999060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:38.999712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:38.999984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.000252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:39.000911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:39.002265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c08d7-6c8e-4551-b10a-2ab0625dae27 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:39.027225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 512/1017] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:39.178323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f197e9-fdc6-4494-951a-f61e43091f3c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:39.178617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f197e9-fdc6-4494-951a-f61e43091f3c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.178878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f197e9-fdc6-4494-951a-f61e43091f3c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:39.180406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 506/1018] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:39.185758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518a8e-dd4b-4eb4-bf0b-3e671f4cbe0a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:39.186059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518a8e-dd4b-4eb4-bf0b-3e671f4cbe0a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.186348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518a8e-dd4b-4eb4-bf0b-3e671f4cbe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:39.204824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e4518a8e-dd4b-4eb4-bf0b-3e671f4cbe0a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:39.205995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e4518a8e-dd4b-4eb4-bf0b-3e671f4cbe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:39.283322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 513/1019] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:39.544946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f197e9-fdc6-4494-951a-f61e43091f3c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:39.603890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:39.653995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f197e9-fdc6-4494-951a-f61e43091f3c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:39.689300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:39.689906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:39.690179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.690441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:39.691088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:39.692491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a590c9-80e3-4df2-bfc0-d0f733d1d885 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:39.708170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 507/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:11:39 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:39.985571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf8f6-a034-43e4-8650-62ad2a47fa0a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:39.986104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf8f6-a034-43e4-8650-62ad2a47fa0a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.986104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf8f6-a034-43e4-8650-62ad2a47fa0a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:39.987651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 514/1021] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:39.993066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:39.993350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:39.993587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:40.012576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:40.013999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:40.090218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:40.355043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf8f6-a034-43e4-8650-62ad2a47fa0a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:40.458846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf8f6-a034-43e4-8650-62ad2a47fa0a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:40.477134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:40.504098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:40.504738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:40.505019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:40.505292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:40.506423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:40.507888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bdd9-5dbd-49fe-9ff0-2a48f224e475 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:40.511238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 515/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:40.515302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:40.557036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:40.620817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61542852-b633-4881-be69-446eb93c2ba3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:40.655777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:40.656391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:40.656668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:40.656935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:40.657583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:40.659029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edded1-4cb0-46e7-9c29-f21d74a14540 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:40.683760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 509/1024] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:11:40 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:41.018154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b268-178c-4501-a7c8-ae4ed5aa8d05 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.018736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b268-178c-4501-a7c8-ae4ed5aa8d05 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.018736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b268-178c-4501-a7c8-ae4ed5aa8d05 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.020224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 516/1025] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:41.025302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.025562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.025854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.044128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:41.045299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:41.115303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 510/1026] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:41.379139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15b268-178c-4501-a7c8-ae4ed5aa8d05 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:41.489046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15b268-178c-4501-a7c8-ae4ed5aa8d05 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:41.523840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:41.524502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.524782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.525057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.535623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ee23d310-af61-4717-94c6-b0177baff0e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:41.540383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:41.541345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:41.544167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 517/1027] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:41.547893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:41.574119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:41.618361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157ed-c0ad-4fe9-beb3-27b330691d06 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.618691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157ed-c0ad-4fe9-beb3-27b330691d06 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.619155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c157ed-c0ad-4fe9-beb3-27b330691d06 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.621774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 518/1028] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:41.626735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.627020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.627326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.645507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:41.646615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:41.654907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea30224-9c18-4620-ae4d-150d9f75e45d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:41.679607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:41.692644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:41.693263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.693583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.693855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.694629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:41.694957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:41.696533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:41.707360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 511/1029] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:41.713387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:41.719357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 519/1030] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:41.805921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:41.825331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef97a8-6ba0-4cc9-bde4-98777f156543 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:41.860995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:41.861615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:41.861889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:41.862149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:41.873343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:41.874783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:41.889283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:41.890220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:41.896409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:41.896409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:41.896409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:41.896409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 512/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:41.896663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:41.984377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.002636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5116-ace5-4317-a91f-8b9629d0f5f0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.040881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.041502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.042068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.042068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.042658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:42.043021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.044459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.056498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 520/1032] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:42.062306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.093042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.094313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdeed-76a9-4d83-8ac2-91e56619a7b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.130173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.130809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.131084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.131380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.131965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.133565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:42.142932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:42.144007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:42.148447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 513/1033] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Sep 2 05:11:41 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:42.150112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.153584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.172357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e590b6-ef9d-4d67-8f64-e580460d3840 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.208077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.208709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.208984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.209252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.217384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.218807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:42.232383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:42.233357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:42.234310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 521/1034] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:42.239398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.256921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf7d49-6845-4b5f-a9f6-88a097f9ddc6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.292446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.293051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.293321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.293584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.294236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:42.294524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.295912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.306016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 514/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:42.307015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.333183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.346686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f42152-aa1c-491f-af22-c18d7357ad63 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.378164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.384204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.384812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.385088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.385355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.386074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:42.386371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.387865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.410059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 522/1036] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:42.411081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.422018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba811a0-3048-47fe-8f82-eafe956d96f6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.465523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.466543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.467053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.468036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.468739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:42.469042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.470467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.475912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 515/1037] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:42.481565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.520426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4022d-327a-467e-a278-80e02ce73aa3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.557850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.558462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.558736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.559000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.574848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.587908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b532a58-ed73-4144-8f22-03792e35e41a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.617148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.625724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.626338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.626613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.626880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.627608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] RBAC: Adding query filter params (interface=public, service_id=0a14257f39bb4a44b6f31f0572369a4b, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:42.627906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.629284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.634508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 516/1038] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/endpoints?service_id=0a14257f39bb4a44b6f31f0572369a4b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:42.634780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.636249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5481617-5bc2-40b1-9154-0f4e3d3cd2e6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.640141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.734769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 523/1039] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:42.736078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6244-974d-4d43-b893-4778576de3ab None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.736361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6244-974d-4d43-b893-4778576de3ab None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.736628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6244-974d-4d43-b893-4778576de3ab None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.737856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 524/1040] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:42.740433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d6244-974d-4d43-b893-4778576de3ab None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:42.743789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d75f-e95a-42a1-a4b4-be24a8e3901c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.777419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.778049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.778488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.778783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.779413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.780764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5355f-c647-423c-a470-f3818ab765e8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.787208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 517/1041] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:11:42.787384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.788434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.788750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.788970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.809456 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:42.813229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:42.874098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d6244-974d-4d43-b893-4778576de3ab None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:42.878341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:42.895089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 518/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:42.912732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:42.913391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:42.913718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:42.913985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:42.925972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:42.927442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:42.943891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:42.944867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:42.945774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:42.945774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:42.945774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:42.945774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 525/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:42.950869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.055330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84be51-6d24-4f8f-904e-109060fddecb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.096241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.096860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.097133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.097396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.098040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:43.098336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.101141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.118443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 519/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:43.119803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.164747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.215421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:43.231790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:43.236095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f861-db9a-4dbc-8369-ada47503ac2a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.271959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.272591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.272863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.273132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.274522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811697b0-2e26-4afb-a118-842e8ace5290 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.279825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.281265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:43.292782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:43.294073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:43.295217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:43.296922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 526/1045] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:43.303499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.313360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.313939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.314218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.314489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.328308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:43.333133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:43.334045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:43.334882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 520/1046] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:43.340244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.428130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd8a7d-1cfe-49e2-be72-60c5e59d4daf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.445028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245ded-673c-446f-a7f7-8a4b669d044f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.455443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:43.470399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.471098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.471500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.471781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.472687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:43.472792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.474219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.486662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.491904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.492024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 527/1047] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:43.492103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.492103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.492103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:43.492103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.492103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.493259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.501366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 521/1048] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:43.507055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.517084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:43.603548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed18a5-5848-4f53-b1ec-1be870c6fa99 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.609157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe535b-ad12-4dae-b17d-b8c1b2056529 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.640323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.640931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.641203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.641469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.642194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] RBAC: Adding query filter params (role.id=8d1632b435e2456780e0553464318fce, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:43.642498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.643941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.644230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.644860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.645131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.645397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] PATH_INFO: `/v3/users/06d6f60310de4830810d09a89262d5f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.649802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 528/1049] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=8d1632b435e2456780e0553464318fce => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:43.662747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] RBAC: Authorizing `identity:get_user(user_id=06d6f60310de4830810d09a89262d5f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.664630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.671531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 522/1050] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/users/06d6f60310de4830810d09a89262d5f3 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:43.672832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:43.766237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:43.787362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e755e-0e1f-4dcf-9c7e-97d5f1fc38ea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:43.822426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:43.823037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:43.823340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:43.823605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:43.895750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:43.897118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:43.980492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:44.001229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 529/1051] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:44.006944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:44.035776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:44.113521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa51f-f2bb-46db-87e9-99dfd9b8b28a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:44.150773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:44.151347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:44.151626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:44.151893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:44.153141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:44.154733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df9d7a-e3e1-45e0-9215-55352263e9cb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:44.156572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 523/1052] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:11:44 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:44.162612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:44.267862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6231-3814-46af-b6a9-53557fa4d0bf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:44.302963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:44.303612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:44.303906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:44.304162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:44.304889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=038892d55dcd4083b45b92d57a917089, user.id=06d6f60310de4830810d09a89262d5f3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:44.305199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:44.306632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e002-4631-42ac-ae28-a39e44e6d69c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:44.312675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 530/1053] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:44 2022] GET /identity/v3/role_assignments?user.id=06d6f60310de4830810d09a89262d5f3&scope.project.id=038892d55dcd4083b45b92d57a917089&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:44.714713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc0a6-659a-404f-b03c-d3140e394ff6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:44.715501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc0a6-659a-404f-b03c-d3140e394ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:44.715501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc0a6-659a-404f-b03c-d3140e394ff6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:44.719243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 524/1054] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:44.722101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:44.722332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:44.722600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:44.741515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:44.743013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:44.788160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:44.815254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 531/1055] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:45.075554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc0a6-659a-404f-b03c-d3140e394ff6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:45.173228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:45.181851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc0a6-659a-404f-b03c-d3140e394ff6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:45.216874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:45.217506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.217773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.218033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.218593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:45.220001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:45.228773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:45.229791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 05:11:45.230646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:45.234958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 525/1056] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Sep 2 05:11:45 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:45.235852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:45.337848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6fddc-c385-4f64-8031-67dafc9e9187 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:45.381817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:45.382436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.382708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.382978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.383644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:45.383948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:45.385311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae481-29f5-47e1-ace5-1da7fe42a64d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:45.390638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 532/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:45.396178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:45.505325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c332e-4768-4d14-a817-3c4c1c24a03a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:45.525020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32229-ea5c-4419-9013-5f49f2ce9c99 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.525305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32229-ea5c-4419-9013-5f49f2ce9c99 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.525589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32229-ea5c-4419-9013-5f49f2ce9c99 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.527086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 533/1058] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:45.531821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.532114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.532396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.543930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:45.544649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.544932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.545216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.545849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:45.546147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:45.547549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:45.550996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:45.552206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:45.552887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 526/1059] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:45.558415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:45.584798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:45.591486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:45.629338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 534/1060] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:45.671061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383cd6-2836-4b84-bf86-ef4c2432cb4f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:45.706898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:45.707545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:45.707866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:45.708137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:45.708793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:45.710157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:45.731222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 527/1061] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:11:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:45.896845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.001537 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323c7c0-fde2-41df-b6cb-ca245a5f416c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.042107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.042749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.043028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.043323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.054115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aeacd619-3626-4ac3-a91e-410b53fc1115 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:46.058904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:46.060136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:46.060968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 535/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:46.066389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.150565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.173204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dba9f4-fd40-47ad-87f8-c8f68dc7d908 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.205698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e8be-0f10-40a2-9176-fb11c0162c7a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.206556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e8be-0f10-40a2-9176-fb11c0162c7a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.206866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301e8be-0f10-40a2-9176-fb11c0162c7a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.208466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 536/1063] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:11:46.209699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.210316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.210590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.210857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.211561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:46.211858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.213232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.213326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.213532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.213811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.223733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 528/1064] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:46.229182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.232583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:46.233786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:46.256074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.304839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 537/1065] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:46.337912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d77b9-17fd-42be-9b6a-967e3510a191 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.375038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.375701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.375974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.376236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.386356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.387912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.389648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:46.403732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:46.404669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:46.405538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:46.405538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:46.405538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:46.407571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 529/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:46.410487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.517092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e786c-5cf9-4b25-91ae-9c318f30ac04 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.552779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.553392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.553670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.553936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.554584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:46.554885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.556320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.568042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 538/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:46.569707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.573436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.592252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.677023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1177-0085-418e-9200-fd2cab4eea7b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.679917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553e94e-3bcb-4c8c-9349-9c91a4845dc3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.711631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.712275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.712553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.712843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.716403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.717043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.717317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.717584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.720632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.722088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.728981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:46.733798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:46.735132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:46.736294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:46.737034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:46.737839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:46.738754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:46.740240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 530/1068] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:46.740618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 539/1069] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:46.745765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.746197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.806636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.834005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:46.857168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344171b-bfc9-40c0-9d3c-fbf68b31c108 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.859463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c8b4-a60b-4303-b61a-2a659240379e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:46.894834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.895477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.895752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.896016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.896672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:46.896897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:46.897021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.897506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:46.897783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:46.898053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:46.898334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.898775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:46.899077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:46.900530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:46.907405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 531/1070] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:46.913090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:46.919582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 540/1071] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:46.925260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.022148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fc78f-f0e5-42ec-97b8-7f2e7d606d24 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.030179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1741de-440c-4e25-9e6c-c41db2da3e75 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.038273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:47.058072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.058712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.058986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.059391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] PATH_INFO: `/v3/users/06d6f60310de4830810d09a89262d5f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.061238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] RBAC: Authorizing `identity:get_user(user_id=06d6f60310de4830810d09a89262d5f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.062679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.064309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 532/1072] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/users/06d6f60310de4830810d09a89262d5f3 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:47.069855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.078116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.078766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.079027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.079328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.081385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:47.092607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.094272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:47.111102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:47.112227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:47.113753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:47.113753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:47.113753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:47.113753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 541/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:47.118230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.179874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c09b6-301e-425a-9562-621da93270b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.223215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.224023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.224304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.224576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.225561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a58c9-6d2c-4264-b289-d2fd63a4828c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.225731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.227230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.233898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 533/1074] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:11:47 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:47.234715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.262979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.263710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.263988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.264230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.264868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:47.265225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.266525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.283326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 542/1075] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:47.284603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.297592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:47.335288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:47.353395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c6e0c-36ae-4068-a709-58dcde45830f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.390911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.391627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.391906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.392175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089/users/06d6f60310de4830810d09a89262d5f3/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.394146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] RBAC: Authorizing `identity:create_grant(project_id=038892d55dcd4083b45b92d57a917089, user_id=06d6f60310de4830810d09a89262d5f3, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.395629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.402459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fffa2-4ba7-4918-afe3-07bf2141daae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.411299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 534/1076] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:47 2022] PUT /identity/v3/projects/038892d55dcd4083b45b92d57a917089/users/06d6f60310de4830810d09a89262d5f3/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:11:47.441878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.442548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.442838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.443102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.450922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.452433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-21a37767-eb50-4782-b748-2a73908772cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:47.464980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:47.466034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:47.466947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:47.468050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 543/1077] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:47.472298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.581659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc36702-6544-4422-b239-fcbcac5ec9ed None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.595848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:47.619969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.620952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.621421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.621946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.622835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:47.623389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.625101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.638185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 535/1078] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:47.643702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ad6b-6c27-4e86-b77b-080d02ab81af None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.643828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:47.644420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ad6b-6c27-4e86-b77b-080d02ab81af None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.644939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ad6b-6c27-4e86-b77b-080d02ab81af None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.646975 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 544/1079] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:47.652939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.653342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.653617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.672531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:47.673741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:47.751490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 545/1080] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:47.754523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd77d30-e978-4601-a41c-2a3e2bbdf52c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:47.789778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:47.790431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:47.790704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:47.790967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/8d1632b435e2456780e0553464318fce` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:47.793145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=5fde80d2e5cd4553b1b282284825d3d6, role_id=8d1632b435e2456780e0553464318fce)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:47.794603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:47.808127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 536/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:47 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/5fde80d2e5cd4553b1b282284825d3d6/roles/8d1632b435e2456780e0553464318fce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:11:48.018536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:48.056305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:48.124743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b13a6d-cb49-4c3b-b8aa-88b6c8140473 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:48.158969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:48.159623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:48.159902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:48.160173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:48.226915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:48.228406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:48.262678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:48.331135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 546/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:48.336902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:48.369835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:48.444692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd85-683c-4c3a-8f2a-d236eb2758b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:48.486521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:48.487161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:48.487466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:48.487736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:48.500149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:48.501664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5df12824-3301-4438-9359-28d6667c8532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:48.516798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:48.517758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:48.519253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:48.519253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:48.519253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:48.519253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 537/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:48.523904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:48.625286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72b37f-28f4-4ced-b320-cf04569a7254 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:48.659510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:48.660118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:48.660396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:48.660670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:48.661314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:48.661619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:48.662984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42263c-13b3-4cc6-99cb-8be39e7af354 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:48.665385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:48.676094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 547/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:49.321723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49fd-9d0f-473c-9399-69e4e9e9a491 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.322317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49fd-9d0f-473c-9399-69e4e9e9a491 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.322317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49fd-9d0f-473c-9399-69e4e9e9a491 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.323621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 538/1085] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:49.329034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236471-5337-40a4-a8ef-65ede994554e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.329319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236471-5337-40a4-a8ef-65ede994554e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.329590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236471-5337-40a4-a8ef-65ede994554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.348858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0c236471-5337-40a4-a8ef-65ede994554e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:49.350023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0c236471-5337-40a4-a8ef-65ede994554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:49.429303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 548/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:49.686769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402041e0-ff32-4e9c-a828-992da7658d6c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.686974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402041e0-ff32-4e9c-a828-992da7658d6c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.687225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402041e0-ff32-4e9c-a828-992da7658d6c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.688596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 539/1087] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:49.693994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.694251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402041e0-ff32-4e9c-a828-992da7658d6c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:49.694388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.694559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.713449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:49.714615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:49.785433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:49.795019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 549/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:11:49.802875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402041e0-ff32-4e9c-a828-992da7658d6c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:49.837044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:49.837668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.837943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.838209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.848324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:49.853130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:49.855423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:49.856550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 540/1089] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:49.860282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:49.916178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:49.960143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e88236-4d0a-4447-8177-a8cf55207b64 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:49.994581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:49.995181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:49.995484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:49.995746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:49.996401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:49.996803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:49.998172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.005979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 550/1090] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:50.011863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.059621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.116600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708e9d-482b-4479-9c9f-53da229c1833 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.151213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.151862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.152138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.152407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] PATH_INFO: `/v3/users/06d6f60310de4830810d09a89262d5f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.153756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] RBAC: Authorizing `identity:get_user(user_id=06d6f60310de4830810d09a89262d5f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.155238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.156807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 541/1091] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/users/06d6f60310de4830810d09a89262d5f3 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:50.162669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.162854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d50f-87d2-47dc-981e-d62080a6606d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.177943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.180145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.197215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.197852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.198135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.198408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.209083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:11:50.213898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:50.214892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:50.215827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 551/1092] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:50.220935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.263495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c006e-e73d-4031-a1e0-8d8a1e21ac62 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.296523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.297152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.297428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.297692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.321449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1adcd-d42d-4a56-a6b7-5ae4fc6f900e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.354497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.355123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.355398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.355670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.356664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:50.356975 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.358347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.364092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.365569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.366691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 552/1093] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:50.372811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.379974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.414638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.470791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 542/1094] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:50.475654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0b86-1bea-470c-9247-b4bde161eff6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.476795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.510741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.511405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.511685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.511951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.522896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.524397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:50.538723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:50.539843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:50.540717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:50.540717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:50.540717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:50.540717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 553/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:50.546599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.574600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487b29-ab09-4eb9-8f50-643b51c0d704 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.587448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.609231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.609856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.610128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.610392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.611508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.612935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.614557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 543/1096] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:50.620917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.638071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.647321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a360f6-acb8-4626-aeda-039a329020e7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.682220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.682832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.683113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.683417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.684084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:50.684535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.686157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.697838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 554/1097] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:50.703601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.725688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d145fa-d0e0-48cb-a5ec-9e45c6446d30 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.759813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.760425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.760701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.760968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.761686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=038892d55dcd4083b45b92d57a917089, user.id=06d6f60310de4830810d09a89262d5f3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:50.761991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.763577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.769294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 544/1098] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/role_assignments?user.id=06d6f60310de4830810d09a89262d5f3&scope.project.id=038892d55dcd4083b45b92d57a917089&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:50.805469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e40e90-3808-41ca-bc67-e60f4bcb336b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:50.843438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:50.844089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:50.844367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:50.844637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:50.852804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:50.854264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:11:50.867008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:50.873476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:11:50.874554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 555/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:50.875144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:50.928878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:50.987291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ec06-89db-481d-9eef-5d060990066e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:51.020888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:51.021501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:51.021783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:51.022050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:51.022774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:51.023073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:51.024528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:51.042020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 545/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Sep 2 05:11:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:11:51.048076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:51.063993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:51.152654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45714-4832-43ff-aac3-5eaabaf6fe9c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:51.187397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4117-20de-4850-ae78-46158327294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:51.188043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4117-20de-4850-ae78-46158327294b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:51.188528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4117-20de-4850-ae78-46158327294b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:51.188528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4117-20de-4850-ae78-46158327294b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:51.257979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b4117-20de-4850-ae78-46158327294b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:51.259375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b4117-20de-4850-ae78-46158327294b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:51.273212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:51.356279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 556/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:51.362221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:51.468682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7d57-6504-40cc-9a4c-e0f75741fcf7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:51.470283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:51.505235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:51.505856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:51.506131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:51.506395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:51.516599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:51.517981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:11:51.532656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:51.533630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:11:51.534522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:11:51.534522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:11:51.534522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:51.534522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 546/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:11:51.539653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4117-20de-4850-ae78-46158327294b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:51.640674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4117-20de-4850-ae78-46158327294b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:51.654356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:51.677228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:51.677866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:51.678146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:51.678422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:51.679068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:51.679399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:51.680758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:51.692377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 557/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:51.698292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:51.804308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cbd08-614c-400f-87f6-61bc79779fc8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:51.845676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:51.846305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:51.846581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:51.846849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:51.854484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:51.856111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:11:51.869123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:11:51.870108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:11:51.871000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 547/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:11:51.876573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:51.980148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215f75-69aa-4013-a84a-a2b2ecd6ee5f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:52.013302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:52.013913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:52.014195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:52.014467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:52.015153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:52.015480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:52.016923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094631cd-3f1b-40a3-bfa0-7926381022f5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:52.029396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 558/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:52.035741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:52.053396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:52.149669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560012e-7725-4b27-9744-8d315de1ed07 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:52.186604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:52.187227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:52.187522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:52.187775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:52.188498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] RBAC: Adding query filter params (role.id=8d1632b435e2456780e0553464318fce, scope.project.id=1920309f691847578cad8f735480b42c, user.id=5fde80d2e5cd4553b1b282284825d3d6) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:52.188800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:52.190244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144c1a-b55a-447a-b3fb-59915497b3d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:52.196479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 548/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:52 2022] GET /identity/v3/role_assignments?user.id=5fde80d2e5cd4553b1b282284825d3d6&scope.project.id=1920309f691847578cad8f735480b42c&role.id=8d1632b435e2456780e0553464318fce => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:52.684780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a99a-1e66-42fc-b3ee-30fe34735c72 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:52.685296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a99a-1e66-42fc-b3ee-30fe34735c72 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:52.685704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a99a-1e66-42fc-b3ee-30fe34735c72 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:52.687981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 559/1107] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:52.693634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:52.694103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:52.694193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:52.713957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:52.715145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:52.797842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 549/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:53.070099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981a99a-1e66-42fc-b3ee-30fe34735c72 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:53.109383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:53.192143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981a99a-1e66-42fc-b3ee-30fe34735c72 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:53.227480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:53.228098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:53.228373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:53.228639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:53.229790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:53.231306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55097df-1236-49d8-8d8e-759cc962f789 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:53.232896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 560/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:11:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:53.242962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:53.259877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:53.353383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c0a0-1a97-476a-92e6-86d534bee330 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:53.389582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:53.390470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:53.390840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:53.391192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:53.392223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:53.394487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6251e50-1aba-40d7-bdff-34c0ee1fe67b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:53.425998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 550/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:11:53 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:11:55.348132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4fd9-2357-449f-8228-faf765ea6492 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:55.348696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4fd9-2357-449f-8228-faf765ea6492 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:55.348696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b4fd9-2357-449f-8228-faf765ea6492 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:55.350009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 561/1111] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:55.356802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:55.357469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:55.357624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:55.382660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:55.383926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:55.451745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:55.463510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 551/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:55.729855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b4fd9-2357-449f-8228-faf765ea6492 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:55.834716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:55.839276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b4fd9-2357-449f-8228-faf765ea6492 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:55.878977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:55.879635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:55.879911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:55.880182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] PATH_INFO: `/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:55.881673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:55.883032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:55.884376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 562/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:55 2022] GET /identity/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:55.891082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:56.002354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177b142-9942-4c05-b6ea-d4160c040c9d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:56.037855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:56.038498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:56.038769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:56.039067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] PATH_INFO: `/v3/users/c272eee9de8f406badafc9c47bed036d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:56.052388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] RBAC: Authorizing `identity:get_user(user_id=c272eee9de8f406badafc9c47bed036d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:56.053834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:56.055441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 552/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:55 2022] GET /identity/v3/users/c272eee9de8f406badafc9c47bed036d => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:56.063573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:56.171174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d162-d189-4ff5-b8b3-b0e682d1f478 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:56.205571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:56.206181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:56.206455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:56.206721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:56.249229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:56.284048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:56.285445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:56.396501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 563/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:11:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:11:56.402983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:56.460550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:56.515582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762df12-c64c-49e0-8947-21da83beea9d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:56.551801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:56.552359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:56.552621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:56.552898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:56.554115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:56.555592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf0f6-495d-4c93-a34f-edd5b6bd967c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:56.557276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 553/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:11:56 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:56.564128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:56.637097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:56.671825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2f8c-9a1b-4b6e-b229-5736dc7e7857 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:56.707209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:56.707817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:56.708095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:56.708367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:56.709087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=038892d55dcd4083b45b92d57a917089, user.id=c272eee9de8f406badafc9c47bed036d) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:11:56.709392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:56.710817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495d84-da0c-438e-9677-8d9bccb00a3a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:56.716686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 564/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:11:56 2022] GET /identity/v3/role_assignments?user.id=c272eee9de8f406badafc9c47bed036d&scope.project.id=038892d55dcd4083b45b92d57a917089&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:58.605813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40295-fdb2-4965-9872-81eaa24dc9dc None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:58.607270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40295-fdb2-4965-9872-81eaa24dc9dc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:58.607270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40295-fdb2-4965-9872-81eaa24dc9dc None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:58.608943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 554/1118] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:11:58.614397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:58.614931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:58.614931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:58.634998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:11:58.636207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:11:58.706554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 565/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:11:58.973225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad40295-fdb2-4965-9872-81eaa24dc9dc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:59.088174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad40295-fdb2-4965-9872-81eaa24dc9dc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:59.109611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:59.126083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:59.126707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:59.126981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:59.127255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] PATH_INFO: `/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:59.128781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:59.130159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:59.131498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 555/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:58 2022] GET /identity/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:59.137807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:59.206619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:59.256980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce608f46-5d8b-4b02-a0c3-8b1a539cd417 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:59.292128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:59.292750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:59.293026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:59.293310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] PATH_INFO: `/v3/users/c272eee9de8f406badafc9c47bed036d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:59.294475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] RBAC: Authorizing `identity:get_user(user_id=c272eee9de8f406badafc9c47bed036d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:59.295981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:59.297565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 566/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:11:59 2022] GET /identity/v3/users/c272eee9de8f406badafc9c47bed036d => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:59.303684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:59.417601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948de4ec-5e74-4e46-90bf-9de7b56d71b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:59.453130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:59.453741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:59.454012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:59.454274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:59.455468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:59.457313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5349a4b-b7f6-429f-a520-278e26b6da35 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:59.458916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 556/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:11:59 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:11:59.465338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:11:59.570628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9953-a9a1-4983-bb9b-f21872df2e44 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:11:59.599908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:11:59.607473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:11:59.608136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:11:59.608414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:11:59.608681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089/users/c272eee9de8f406badafc9c47bed036d/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:11:59.610941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] RBAC: Authorizing `identity:create_grant(project_id=038892d55dcd4083b45b92d57a917089, user_id=c272eee9de8f406badafc9c47bed036d, role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:11:59.612422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55aa78-62f9-47c8-b156-fa017b499818 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:11:59.631974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 567/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:11:59 2022] PUT /identity/v3/projects/038892d55dcd4083b45b92d57a917089/users/c272eee9de8f406badafc9c47bed036d/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:12:01.476421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199063d8-a0e9-4791-ab5e-da5173cc56e5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:01.477159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199063d8-a0e9-4791-ab5e-da5173cc56e5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:01.477311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199063d8-a0e9-4791-ab5e-da5173cc56e5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:01.479531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 557/1124] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:01.484942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:01.485395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:01.485495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:01.504449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:01.505625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:01.577268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 568/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:01.840187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199063d8-a0e9-4791-ab5e-da5173cc56e5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:01.913202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:01.967848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199063d8-a0e9-4791-ab5e-da5173cc56e5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:02.005555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:02.006167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:02.006439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:02.006706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] PATH_INFO: `/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:02.008146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e34d9f7f3b429ba2e0fa4739dba4c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:02.009503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:02.010813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 558/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:01 2022] GET /identity/v3/roles/c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:02.016739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:02.117382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6f66-18fa-4797-aea7-e4da029e4ab8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:02.137509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:02.155112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:02.155779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:02.156061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:02.156331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] PATH_INFO: `/v3/users/c272eee9de8f406badafc9c47bed036d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:02.157494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] RBAC: Authorizing `identity:get_user(user_id=c272eee9de8f406badafc9c47bed036d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:02.158931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:02.160553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 569/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:02 2022] GET /identity/v3/users/c272eee9de8f406badafc9c47bed036d => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:02.166298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:02.273582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904da2c-88c4-4fa1-a304-b6d8df436dc0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:02.299559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:02.314040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:02.314636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:02.314908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:02.315175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:02.384655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:02.386039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:02.489354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 559/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:12:02.495773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:02.600506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733cf69-15f7-4b08-a5e4-da90a35bba73 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:02.644707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:02.645279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:02.645566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:02.645791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] PATH_INFO: `/v3/projects/038892d55dcd4083b45b92d57a917089` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:02.647068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] RBAC: Authorizing `identity:get_project(project_id=038892d55dcd4083b45b92d57a917089)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:02.648516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b7a0-5279-4858-8bae-672eadc5cac8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:02.650132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 570/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:02 2022] GET /identity/v3/projects/038892d55dcd4083b45b92d57a917089 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:02.658233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:02.683378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:02.765552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8be69c-5ed8-4570-a79f-ebde081c5aa5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:02.800022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:02.800647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:02.800924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:02.801189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:02.801900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] RBAC: Adding query filter params (role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3, scope.project.id=038892d55dcd4083b45b92d57a917089, user.id=c272eee9de8f406badafc9c47bed036d) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:02.802201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:02.803668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815c05e-2075-414f-9ac9-543397a4596f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:02.809559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 560/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:12:02 2022] GET /identity/v3/role_assignments?user.id=c272eee9de8f406badafc9c47bed036d&scope.project.id=038892d55dcd4083b45b92d57a917089&role.id=c6e34d9f7f3b429ba2e0fa4739dba4c3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:04.741442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6fd6f-eeec-4ecc-833f-c4e308a9cd00 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:04.742668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6fd6f-eeec-4ecc-833f-c4e308a9cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:04.742668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6fd6f-eeec-4ecc-833f-c4e308a9cd00 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:04.744880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 571/1131] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:04.751095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:04.751551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:04.751735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:04.776031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:04.777217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:04.857419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 561/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:05.126522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6fd6f-eeec-4ecc-833f-c4e308a9cd00 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:05.198611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:05.250633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6fd6f-eeec-4ecc-833f-c4e308a9cd00 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:05.285486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:05.286107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:05.286379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:05.286641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:05.287860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:05.289284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5d692-3017-4031-8f76-57f86698ee9c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:05.290853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 572/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:05.297274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:05.316767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:05.410388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21345c-a959-437a-9809-684f687f31a7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:05.453378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:05.453988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:05.454268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:05.454535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:05.455217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:05.456689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81859ee-9512-4249-857a-70537c0ab036 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:05.493840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 562/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:12:05 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:12:07.465729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245d9b-d706-4463-80bd-8a17fb159ad6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:07.466272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245d9b-d706-4463-80bd-8a17fb159ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:07.466272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245d9b-d706-4463-80bd-8a17fb159ad6 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:07.467842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 573/1135] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:07.473959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:07.474677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:07.474828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:07.496137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:07.497394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:07.585289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:07.593891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 563/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:07.877778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21245d9b-d706-4463-80bd-8a17fb159ad6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:07.991566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21245d9b-d706-4463-80bd-8a17fb159ad6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:08.015835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:08.032957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:08.033585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:08.033860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:08.034125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:08.035316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:08.036745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94e10-f8b0-4d39-9fe5-6efc9eadd11a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:08.038312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 574/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:08.044328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:08.149913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac624f4-1fa9-49cb-8499-4fb60b118f23 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:08.195879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:08.196496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:08.196783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:08.197053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:08.197710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:08.199261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cfa6-cf45-4009-9bff-9075a18f4a82 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:08.224865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 564/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:12:08 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:12:10.152433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafefe9-1054-458f-9fe5-764d627e3282 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:10.153015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafefe9-1054-458f-9fe5-764d627e3282 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:10.153247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafefe9-1054-458f-9fe5-764d627e3282 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:10.155507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 575/1139] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:10.164247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:10.164654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:10.164799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:10.191308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:10.192495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:10.250091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:10.268504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 565/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:10.527617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafefe9-1054-458f-9fe5-764d627e3282 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:10.656510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafefe9-1054-458f-9fe5-764d627e3282 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:10.691592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:10.692215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:10.692486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:10.692748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:10.703883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:10.708655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:10.709799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:10.710898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 576/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:10.716175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:10.823767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3004a2-cd0e-4300-b0da-a71db4059ed2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:10.863180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:10.863836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:10.864107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:10.864367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:10.865059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:10.865363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:10.866763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:10.875570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 566/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:10.884807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:10.948398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:11.007377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6009-fc9c-4bae-af94-9b936fcb6765 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:11.044305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:11.044923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:11.045198 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:11.045470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] PATH_INFO: `/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:11.059947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] RBAC: Authorizing `identity:get_user(user_id=1e428e57b8fc42baae4ddf2e7a157a9c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:11.061391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:11.062998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 577/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:10 2022] GET /identity/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:11.069314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:11.124008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:11.182103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87033cf5-f44c-4f85-a78d-05ecaa1468ae None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:11.217303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:11.217907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:11.218181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:11.218448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:11.292229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:11.293745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:11.345024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:11.398306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 567/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 05:12:11.407075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:11.524268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f84c49-36d3-4af0-bdab-0f1aa0edd903 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:11.534861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:11.560627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:11.561251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:11.561523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:11.561793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] PATH_INFO: `/v3/projects/11f48eb25da94f13a4880d24aebe7803` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:11.562950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] RBAC: Authorizing `identity:get_project(project_id=11f48eb25da94f13a4880d24aebe7803)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:11.564412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8bc5-c0b6-4748-b29c-b94fc7ad4401 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:11.566064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 578/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:11 2022] GET /identity/v3/projects/11f48eb25da94f13a4880d24aebe7803 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:12:11.572587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:11.692003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcbd9-9d8e-4f5c-88af-a02e9ab74fb5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:11.730295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:11.730930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:11.731235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:11.731500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:11.732215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=11f48eb25da94f13a4880d24aebe7803, user.id=1e428e57b8fc42baae4ddf2e7a157a9c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:11.732512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:11.733939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce547d-0c62-4af8-8e97-fb823271f58c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:11.739926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 568/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:12:11 2022] GET /identity/v3/role_assignments?user.id=1e428e57b8fc42baae4ddf2e7a157a9c&scope.project.id=11f48eb25da94f13a4880d24aebe7803&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:13.616732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f6dc-2d47-4676-ae46-a027ae52fc24 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:13.617583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f6dc-2d47-4676-ae46-a027ae52fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:13.617877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f6dc-2d47-4676-ae46-a027ae52fc24 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:13.619255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 579/1147] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:13.625610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:13.626339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:13.626496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:13.656972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:13.658866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:13.670390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:13.734756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 569/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:14.000295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f6dc-2d47-4676-ae46-a027ae52fc24 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:14.118285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f6dc-2d47-4676-ae46-a027ae52fc24 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:14.156137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:14.156759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:14.157036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:14.157311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:14.168453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:14.173232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:14.174288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:14.175137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 580/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:14.181031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:14.304173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023b40-fbf1-4cb2-b6a4-b9cf58eb3308 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:14.342089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:14.342689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:14.342963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:14.343243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:14.343904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:14.344210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:14.345571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:14.353698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 570/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:14.362418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:14.405714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:14.468031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b32e9-67ee-4b66-be79-551d1693ac38 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:14.504788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:14.505423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:14.505695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:14.505961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] PATH_INFO: `/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:14.507112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] RBAC: Authorizing `identity:get_user(user_id=1e428e57b8fc42baae4ddf2e7a157a9c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:14.508609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:14.510169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 581/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:14 2022] GET /identity/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:14.518473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:14.523145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:14.627113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce538ea-b07f-4e2b-b2a2-bc60bb7071df None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:14.662234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:14.662838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:14.663107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:14.663404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] PATH_INFO: `/v3/projects/11f48eb25da94f13a4880d24aebe7803` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:14.664544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] RBAC: Authorizing `identity:get_project(project_id=11f48eb25da94f13a4880d24aebe7803)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:14.665970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0f0d2-f074-4ad0-b863-5f4c26e568b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:14.667642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 571/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:14 2022] GET /identity/v3/projects/11f48eb25da94f13a4880d24aebe7803 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:14.673776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:14.774947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c32a9e-42db-4567-b15b-93768e581651 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:14.782101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:14.811631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:14.812270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:14.812542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:14.812812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] PATH_INFO: `/v3/projects/11f48eb25da94f13a4880d24aebe7803/users/1e428e57b8fc42baae4ddf2e7a157a9c/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:14.814782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f48eb25da94f13a4880d24aebe7803, user_id=1e428e57b8fc42baae4ddf2e7a157a9c, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:14.816234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd52888-30ac-49ba-ba8b-b69e8ac39849 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:14.832406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 582/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:12:14 2022] PUT /identity/v3/projects/11f48eb25da94f13a4880d24aebe7803/users/1e428e57b8fc42baae4ddf2e7a157a9c/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:12:16.700616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1f61-1815-4341-9868-91935bd43268 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:16.701198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1f61-1815-4341-9868-91935bd43268 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:16.701198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1f61-1815-4341-9868-91935bd43268 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:16.702506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 572/1154] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:16.708926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:16.709375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:16.709476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:16.736495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:16.737676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:16.812692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 583/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:17.084838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1f61-1815-4341-9868-91935bd43268 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:17.166659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:17.210755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1f61-1815-4341-9868-91935bd43268 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:17.248586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:17.249204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:17.249476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:17.249738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:17.264591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:17.269306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:17.270440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:12:17.271720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 573/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:17.278952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:17.376147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:17.386901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35cefa-b5f0-4db4-b54e-6b69f66f9d5c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:17.420850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:17.421453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:17.421727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:17.421995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:17.422648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:17.422946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:17.424337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:17.432069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 584/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:17.438615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:17.552106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358a42-411b-4bb7-a474-bd1dced84825 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:17.582586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:17.591114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:17.592033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:17.592311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:17.592579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] PATH_INFO: `/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:17.593708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] RBAC: Authorizing `identity:get_user(user_id=1e428e57b8fc42baae4ddf2e7a157a9c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:17.595151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:17.596754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 574/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:17 2022] GET /identity/v3/users/1e428e57b8fc42baae4ddf2e7a157a9c => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:17.603639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:17.744962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d3be-1e21-49ca-b52e-f69606081b4e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:17.780274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:17.780883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:17.781183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:17.781430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:17.809400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:17.853713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:17.855337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:17.956737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 585/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:12:17.963284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:18.072856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b91246-e4b5-4ac7-82b3-15a6395111c3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:18.112317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:18.113215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:18.113537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:18.113879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] PATH_INFO: `/v3/projects/11f48eb25da94f13a4880d24aebe7803` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:18.115880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] RBAC: Authorizing `identity:get_project(project_id=11f48eb25da94f13a4880d24aebe7803)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:18.118460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667468b9-5e02-480a-b533-64b810fe0184 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:18.121018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 575/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:17 2022] GET /identity/v3/projects/11f48eb25da94f13a4880d24aebe7803 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:18.127642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:18.186241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:18.230435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaca45-5b13-4494-867c-b0f2b29dafde None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:18.279297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:18.279898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:18.280176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:18.280446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:18.281171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=11f48eb25da94f13a4880d24aebe7803, user.id=1e428e57b8fc42baae4ddf2e7a157a9c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:18.281479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:18.283066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3c51-cbe1-43fa-bba8-c43e88669d75 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:18.289537 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 586/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:12:18 2022] GET /identity/v3/role_assignments?user.id=1e428e57b8fc42baae4ddf2e7a157a9c&scope.project.id=11f48eb25da94f13a4880d24aebe7803&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:20.209200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7f7ab-02b6-4a25-8f64-1b877435bcc9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:20.210040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7f7ab-02b6-4a25-8f64-1b877435bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:20.210040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7f7ab-02b6-4a25-8f64-1b877435bcc9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:20.212265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 576/1162] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:20.218625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:20.219395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:20.219552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:20.242795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:20.243999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:20.313401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 587/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:20.586555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7f7ab-02b6-4a25-8f64-1b877435bcc9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:20.660453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:20.699251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7f7ab-02b6-4a25-8f64-1b877435bcc9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:20.738886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:20.739509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:20.739778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:20.740041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:20.812930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:20.814395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:20.890000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:20.930539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 577/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:12:20.937548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:20.996359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:21.050652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392765c-ccb8-4703-bcbc-465184383408 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:21.087108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:21.087783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:21.088048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:21.088321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:21.095712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:21.097157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6dbce566-57bf-4141-a0f5-d5ca2639d678 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:21.109138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:21.110294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:21.111273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 588/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:12:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:21.116582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:21.227757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1134-5bbf-4dcb-91c6-9282afba8347 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:21.263431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:21.263949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:21.264222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:21.264495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:21.265131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:21.265430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:21.266816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a812f1-70fd-4688-94d9-dc979097ffc0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:21.274075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 578/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Sep 2 05:12:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:23.151328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b6b6-7249-463e-91ea-5ab94c34a421 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:23.152144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b6b6-7249-463e-91ea-5ab94c34a421 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:23.152448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b6b6-7249-463e-91ea-5ab94c34a421 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:23.154588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 589/1167] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:23.160230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31c71-b1de-4d4d-81b4-c837b9780443 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:23.160616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31c71-b1de-4d4d-81b4-c837b9780443 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:23.160772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31c71-b1de-4d4d-81b4-c837b9780443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:23.181270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-eeb31c71-b1de-4d4d-81b4-c837b9780443 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:23.182446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eeb31c71-b1de-4d4d-81b4-c837b9780443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:23.213058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:23.258700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 579/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:23.534500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b6b6-7249-463e-91ea-5ab94c34a421 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:23.655087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b6b6-7249-463e-91ea-5ab94c34a421 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:23.670702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:23.694024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:23.694626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:23.694894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:23.695157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:23.695848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:23.697235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0335b92-62be-4e6d-8642-f3f41abeceae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:23.715699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 590/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Fri Sep 2 05:12:23 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:12:25.628756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579395e-90e2-44a9-a865-3e9040cb4ff3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:25.629616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579395e-90e2-44a9-a865-3e9040cb4ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:25.629616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579395e-90e2-44a9-a865-3e9040cb4ff3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:25.631876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 580/1170] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:25.638122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:25.638557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:25.638667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:25.671511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:25.672719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:25.741921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 591/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:26.013069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579395e-90e2-44a9-a865-3e9040cb4ff3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:26.135559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579395e-90e2-44a9-a865-3e9040cb4ff3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:26.174411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:26.175033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:26.175342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:26.175609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] PATH_INFO: `/v3/domains/679c9337c0e340f89a2b249a6631be17` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:26.186480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=679c9337c0e340f89a2b249a6631be17)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:26.187964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2fdb7-8a65-4b04-be06-c5e5ca660b36 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:26.189536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 581/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Sep 2 05:12:26 2022] GET /identity/v3/domains/679c9337c0e340f89a2b249a6631be17 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:26.196060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:26.301645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0e41-546b-4dd6-93e4-a4d775b9f84c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:26.303279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:26.341688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:26.342297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:26.342577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:26.342854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:26.343536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:26.344978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35851cc-b9ac-4548-9914-3259b89eac52 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:26.374719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 592/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:12:26 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:12:28.330064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df12a7-cd9e-4065-87ef-a3347e815429 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:28.331078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df12a7-cd9e-4065-87ef-a3347e815429 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:28.331078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df12a7-cd9e-4065-87ef-a3347e815429 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:28.333067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 582/1174] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:28.341384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:28.341825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:28.341958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:28.371019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:28.372253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:28.443391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 593/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:28.704711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df12a7-cd9e-4065-87ef-a3347e815429 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:28.747405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:28.828920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df12a7-cd9e-4065-87ef-a3347e815429 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:28.863475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:28.864091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:28.864360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:28.864629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] PATH_INFO: `/v3/domains/679c9337c0e340f89a2b249a6631be17` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:28.865776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] RBAC: Authorizing `identity:get_domain(domain_id=679c9337c0e340f89a2b249a6631be17)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:28.867553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4571e35-5f3a-438d-a7e5-c3ea818e381b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:28.869085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 583/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Sep 2 05:12:28 2022] GET /identity/v3/domains/679c9337c0e340f89a2b249a6631be17 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:28.875191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:28.964684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:28.981614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295accf7-2532-4537-8f3f-9f0f0ba127a5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:29.016918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:29.017514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:29.017790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:29.018061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:29.018707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:29.020189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537ffd2-f2ec-462e-a244-9f445bbf7cc9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:29.047413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 594/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:12:28 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:12:30.964966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93939-a1d6-40bb-a33f-53ef662012fd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:30.965550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93939-a1d6-40bb-a33f-53ef662012fd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:30.965550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93939-a1d6-40bb-a33f-53ef662012fd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:30.966848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 584/1178] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:30.973215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:30.973957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:30.974140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:30.998608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:30.999833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:31.073858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 595/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:31.347884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93939-a1d6-40bb-a33f-53ef662012fd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:31.446119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:31.457366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93939-a1d6-40bb-a33f-53ef662012fd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:31.502383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:31.503013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:31.503322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:31.503588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:31.516050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:31.520825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:31.521970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:12:31.523104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 585/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:31.530405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:31.604751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:31.636873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594caa1-68a4-4038-89f9-b69228b42919 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:31.673450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:31.674059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:31.674345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:31.674613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:31.675304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:31.675606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:31.676989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:31.685287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 596/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:31.692209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:31.807646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84444-63d8-47ae-b0aa-095facf536af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:31.843295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:31.843916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:31.844185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:31.844449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] PATH_INFO: `/v3/users/874edb6fb07d440d84377de4b8e3b00a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:31.858045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] RBAC: Authorizing `identity:get_user(user_id=874edb6fb07d440d84377de4b8e3b00a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:31.859462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:31.861030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 586/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:31 2022] GET /identity/v3/users/874edb6fb07d440d84377de4b8e3b00a => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:31.870882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:31.982431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3dabe-ab9e-4a8f-a770-34725d5f04d9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:32.012298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:32.020277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:32.021159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:32.021562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:32.021950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:32.091130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:32.092593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:32.195246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 597/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:12:32.202683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:32.214275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:32.308320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70d200-f09c-4833-999b-19c3c86033e2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:32.343820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:32.344439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:32.344713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:32.344980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] PATH_INFO: `/v3/projects/1275435d22b94702b1c4f075d7f8eb81` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:32.346127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1275435d22b94702b1c4f075d7f8eb81)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:32.347596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67956788-d018-4740-94e6-f03e4eab22f8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:32.349190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 587/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:32 2022] GET /identity/v3/projects/1275435d22b94702b1c4f075d7f8eb81 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:12:32.355714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:32.388199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:32.462274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5324-c22b-4d81-9955-4cbc425a6825 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:32.503449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:32.504055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:32.504333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:32.504600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:32.505324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1275435d22b94702b1c4f075d7f8eb81, user.id=874edb6fb07d440d84377de4b8e3b00a) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:32.505638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:32.507097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597049-878b-4ce3-b81d-3fb3db8d74de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:32.512841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 598/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:12:32 2022] GET /identity/v3/role_assignments?user.id=874edb6fb07d440d84377de4b8e3b00a&scope.project.id=1275435d22b94702b1c4f075d7f8eb81&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:34.379565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14b75-55e2-40ad-afbe-7540e4c2bddf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:34.380124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14b75-55e2-40ad-afbe-7540e4c2bddf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:34.380124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14b75-55e2-40ad-afbe-7540e4c2bddf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:34.381474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 588/1186] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:34.387797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:34.388512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:34.388650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:34.418434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:34.419664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:34.497027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 599/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:34.765051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14b75-55e2-40ad-afbe-7540e4c2bddf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:34.846645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:34.872531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14b75-55e2-40ad-afbe-7540e4c2bddf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:34.907786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:34.908406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:34.908680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:34.908946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:34.919756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:34.924499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:34.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:12:34.926590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 589/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:34.932446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:34.963440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:35.037671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cec48-396a-42ce-a6ea-a484ce6c0ca6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:35.075485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:35.076093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:35.076373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:35.076647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:35.077312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:35.077614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:35.078993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:35.087000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 600/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:35.093285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:35.216256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7580f-fb7e-4bc0-ac7f-116c1c0cb621 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:35.253567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:35.254194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:35.254468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:35.254746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] PATH_INFO: `/v3/users/874edb6fb07d440d84377de4b8e3b00a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:35.255995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=874edb6fb07d440d84377de4b8e3b00a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:35.257438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:35.259020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 590/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:35 2022] GET /identity/v3/users/874edb6fb07d440d84377de4b8e3b00a => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:35.265167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:35.359129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:35.373557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab455-8d27-4f66-bf97-b26533ce7b13 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:35.408708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:35.409319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:35.409582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:35.409847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] PATH_INFO: `/v3/projects/1275435d22b94702b1c4f075d7f8eb81` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:35.410996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1275435d22b94702b1c4f075d7f8eb81)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:35.412440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4c2c-3c55-4ea3-8cab-f812a46cc7d2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:35.414049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 601/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:35 2022] GET /identity/v3/projects/1275435d22b94702b1c4f075d7f8eb81 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:35.420869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:35.427006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:35.538988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eaaf0-1cef-49c0-b78a-47cec59d5ab0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:35.577126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:35.577776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:35.578049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:35.578320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] PATH_INFO: `/v3/projects/1275435d22b94702b1c4f075d7f8eb81/users/874edb6fb07d440d84377de4b8e3b00a/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:35.580325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1275435d22b94702b1c4f075d7f8eb81, user_id=874edb6fb07d440d84377de4b8e3b00a, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:35.581780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352f6ea-cac9-408b-a537-4bcb4c3c20d5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:35.598053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 591/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:12:35 2022] PUT /identity/v3/projects/1275435d22b94702b1c4f075d7f8eb81/users/874edb6fb07d440d84377de4b8e3b00a/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:12:37.488148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a6a7-6993-4d17-9eb5-d3eb9a2ec5dd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:37.488688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a6a7-6993-4d17-9eb5-d3eb9a2ec5dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:37.488688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a6a7-6993-4d17-9eb5-d3eb9a2ec5dd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:37.490045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 602/1193] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:12:37.495723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:37.496135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:37.496241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:37.515877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:12:37.517053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:12:37.590583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:37.599806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 592/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:12:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:12:37.860835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a6a7-6993-4d17-9eb5-d3eb9a2ec5dd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:37.974944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a6a7-6993-4d17-9eb5-d3eb9a2ec5dd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:38.010682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:38.011290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:38.011565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:38.011830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:38.023066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:12:38.027838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:12:38.028901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:12:38.029953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 603/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:12:38.036780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:38.141346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4383-6a65-4cd7-a4ba-a31cdad67ffb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:38.180224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:38.180827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:38.181097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:38.181366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:38.182021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:38.182294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:38.183761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:38.191707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 593/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:12:38.198507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:38.218373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:38.313116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458386-eb42-4c45-85a5-bbff8273f9b7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:38.348548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:38.349170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:38.349449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:38.349716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] PATH_INFO: `/v3/users/874edb6fb07d440d84377de4b8e3b00a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:38.350951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] RBAC: Authorizing `identity:get_user(user_id=874edb6fb07d440d84377de4b8e3b00a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:38.352403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:38.353969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 604/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Sep 2 05:12:38 2022] GET /identity/v3/users/874edb6fb07d440d84377de4b8e3b00a => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:38.360238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:38.420677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:38.477992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1633-39b2-4fd2-945a-318bfe471231 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:38.516497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:38.517078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:38.517371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:38.517639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:38.590227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:38.591727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:38.655266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:38.714170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 594/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:12:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:12:38.720394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:38.810888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:38.827807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85ab33-5d5b-4699-83ac-b0484634ccac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:38.861062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:38.861739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:38.861981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:38.862274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] PATH_INFO: `/v3/projects/1275435d22b94702b1c4f075d7f8eb81` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:38.863459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] RBAC: Authorizing `identity:get_project(project_id=1275435d22b94702b1c4f075d7f8eb81)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:38.864860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e742c3-5f6b-4bcb-ba56-5bebbb4dd227 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:38.866832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 605/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Sep 2 05:12:38 2022] GET /identity/v3/projects/1275435d22b94702b1c4f075d7f8eb81 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:38.873478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:12:38.975708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30cfd4-806b-4d05-a7fb-8a71764b0b22 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:12:39.010012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:12:39.010656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:12:39.010923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:12:39.011224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:12:39.011949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1275435d22b94702b1c4f075d7f8eb81, user.id=874edb6fb07d440d84377de4b8e3b00a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:12:39.012255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:12:39.013692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb51a1-2048-4c10-b46b-984d752fafd2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:12:39.019265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 595/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:12:38 2022] GET /identity/v3/role_assignments?user.id=874edb6fb07d440d84377de4b8e3b00a&scope.project.id=1275435d22b94702b1c4f075d7f8eb81&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:12:48.856531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=24 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:12:49.016860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:33.992003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12006b15-0a5c-442b-86e0-1c0c1f431e39 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:33.992609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12006b15-0a5c-442b-86e0-1c0c1f431e39 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:33.992609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12006b15-0a5c-442b-86e0-1c0c1f431e39 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:33.994038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 606/1201] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:13:33.999554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:34.000027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:34.000112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:34.022460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:34.023758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:34.103242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 596/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:13:34.370341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12006b15-0a5c-442b-86e0-1c0c1f431e39 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:34.505707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12006b15-0a5c-442b-86e0-1c0c1f431e39 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:34.558426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:34.559082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:34.559410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:34.559659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:34.575152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:34.576667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:34.597169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:34.598942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:34.600284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:34.600284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:34.600284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:34.600284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 607/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:34.605133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:34.762752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d462-fe26-4054-93f9-66c405dc107e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:34.803247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:34.814864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:34.815809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:34.816254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:34.816663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:34.817542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:34.817886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:34.820065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce439-cb4e-4e35-9e05-e43cdaa190f8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:34.834890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 597/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:34.844327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:34.919019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:35.001780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32881-517e-4736-ba06-76a10c4b8519 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:35.050680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:35.052127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:35.053056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:35.053705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:35.055147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:35.057622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da837aa-1aa2-4fdc-895f-87829775dfb9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:35.087419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 608/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Sep 2 05:13:34 2022] POST /identity/v3/users => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:13:37.180898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cce62-07dd-4436-9a8e-129a1decb8f3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:37.180898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cce62-07dd-4436-9a8e-129a1decb8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:37.180898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cce62-07dd-4436-9a8e-129a1decb8f3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:37.180898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 598/1206] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:13:37.186702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:37.187421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:37.187421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:37.208885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:37.210101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:37.287495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 609/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:13:37.557610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cce62-07dd-4436-9a8e-129a1decb8f3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:37.676391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cce62-07dd-4436-9a8e-129a1decb8f3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:37.716140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:37.716829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:37.717111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:37.717381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:37.730448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:13:37.736443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:37.737485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:37.747150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 599/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:13:37.747909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:37.789412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:37.855606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e089a11-2a8c-41b4-9fad-c50969fcf501 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:37.893608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:37.894241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:37.894513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:37.894879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:37.895536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:37.895897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:37.897351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:37.906164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 610/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:13:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:37.912224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:37.977965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:38.035772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319b96-7a8b-49e0-8036-46595d196dd1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:38.072628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:38.073274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:38.073725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:38.073843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:38.088518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:38.090181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:38.108064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:38.109132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:38.110017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:38.110017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:38.110017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:38.110017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 600/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:38.116627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:38.238017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:38.242024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b505b-ec85-41f0-966a-5505af7e10bf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:38.294982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:38.295593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:38.295903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:38.296231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:38.296989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:38.297320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:38.298868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:38.317292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 611/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:38.324136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:38.438557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299240a-1890-4b9b-a6d7-3dee6e776bef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:38.440572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:38.478852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:38.479606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:38.479877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:38.480143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:38.488381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:38.489884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:13:38.502966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:38.504088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:38.509905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 601/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:38.510513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:38.627980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b9a1-214f-4dea-8895-28fbe8acdf42 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:38.670945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:38.671494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:38.671914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:38.672027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:38.672703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:38.673011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:38.676684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:38.694518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 612/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:13:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:38.700628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:38.819239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1711ee-d5bc-4d85-8acd-f4d5afbf480b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:38.859946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:38.860608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:38.860875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:38.861185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:38.896880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:38.943633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:38.945691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:39.080510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 602/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:13:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 05:13:39.087916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:39.113828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:39.221698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5e8c-dadf-476c-afd7-298ad081334f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:39.265652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:39.266416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:39.266640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:39.266906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:39.280928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:39.283608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:39.302354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:39.303431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:39.304379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:39.304379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:39.304379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:39.309665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:39.313220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 613/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:39.390795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:39.447237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43992-dcf5-4cdf-91d1-185ebee28302 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:39.495255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:39.495967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:39.496335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:39.496693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:39.497431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:39.497818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:39.499300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:39.512218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 603/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:39.519528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:39.609904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:39.645122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ac38a-fc0c-4906-9300-8b1613f6d7d1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:39.691325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:39.691962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:39.692240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:39.692510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:39.700086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:39.701531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:13:39.714009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:39.714942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:39.715931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 614/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:39.721096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:39.843498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9df1-a9f8-4e2e-b419-52d7105d6154 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:39.870183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:39.883318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:39.883914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:39.884207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:39.884585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:39.885284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:39.885553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:39.887126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97288f2d-8570-4f41-bc9a-42b0589ff536 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:39.900438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 604/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:13:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:39.906431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:40.026096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a09c8-13f3-45f0-892d-0fba2b448122 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:40.055737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:40.062287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:40.062976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:40.063355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:40.063693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:40.064485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8f966288c77849f1b591bd3fc8fbd8fc) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:40.064908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:40.066399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e2b89-2d5d-4fd6-addb-35b82947f417 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:40.079241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 615/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:13:39 2022] GET /identity/v3/role_assignments?user.id=8f966288c77849f1b591bd3fc8fbd8fc&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:42.157996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a470b-f784-47f5-b6a8-5d85b13ef374 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:42.158554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a470b-f784-47f5-b6a8-5d85b13ef374 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:42.158554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a470b-f784-47f5-b6a8-5d85b13ef374 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:42.160343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 605/1220] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:13:42.166404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:42.166860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:42.166962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:42.189204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:42.189204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:42.260665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 616/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:13:42.567306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a470b-f784-47f5-b6a8-5d85b13ef374 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:42.679330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a470b-f784-47f5-b6a8-5d85b13ef374 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:42.716868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:42.717826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:42.718082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:42.718457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:42.730668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:13:42.736990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:42.737931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:42.738809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:42.743358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 606/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:13:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:42.746035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:42.858345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f0f3-9505-4b9d-83a0-12acc92fffad None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:42.885249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:42.896664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:42.897275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:42.897551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:42.897819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:42.898723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:42.899187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:42.900618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:42.909019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 617/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:13:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:42.915121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:42.967842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:43.034533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbffb6-b3a9-45d9-821e-fb93253c31a9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.069097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:43.069707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:43.070061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:43.070442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:43.081045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:43.082502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:43.098512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:43.099762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:43.100810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:43.100810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:43.100810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:43.100810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 607/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:43.106371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:43.219413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45b93c-769c-4351-9e66-ceb9e7888997 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.259121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:43.259772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:43.260050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:43.260325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:43.260981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:43.261277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:43.262657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:43.275057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 618/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:43.280693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:43.379459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:43.387863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3c71a-3cdb-4be0-a684-f71c838ab982 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.429059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:43.429861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:43.430183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:43.430512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:43.439274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:43.440904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:13:43.454292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:43.455492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:43.456427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 608/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:43.462253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:43.514369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:43.572049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c19a-b5a6-44b1-ae55-9eeab2110702 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.609010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:43.609615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:43.609889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:43.610158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:43.610888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:43.611185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:43.612638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:43.631614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 619/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:13:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:43.638217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:43.746589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e29c-0658-446c-b57b-daba5fd968a8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.786020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:43.786658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:43.786927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:43.787191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:43.799622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:43.801057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:43.817172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:43.818288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:43.819786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:43.819786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:43.819786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:43.819786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 609/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:13:43.826362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:43.941644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543b61-e25b-49a0-8be7-807419f7fb5d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:43.945442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:44.001724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:44.002494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:44.002902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:44.003292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:44.004190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:44.004638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:44.006279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:44.018541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 620/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:44.025045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:44.034714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:44.133544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296503-39a7-4043-9667-dd1ecce3e7bb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:44.169971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:44.170604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:44.170878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:44.171143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:44.177955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:44.179477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:13:44.193787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:44.194953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:44.196054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 610/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:44.201162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:44.318747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc5b2-2b55-456e-8112-5f478e29ec95 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:44.360291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:44.360946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:44.361252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:44.361519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:44.362288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:44.362586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:44.364048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec44d8-8cb9-44f5-bf88-c97d245e7fe9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:44.377890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 621/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:44.384284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:44.463268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:44.503628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bae89-8580-4d31-85ad-e0e2fc7c445a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:44.540893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:44.541578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:44.541853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:44.542123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/8f966288c77849f1b591bd3fc8fbd8fc/roles/6b01e46d2f154d92b9d4d0f9273bb356` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:44.557724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=8f966288c77849f1b591bd3fc8fbd8fc, role_id=6b01e46d2f154d92b9d4d0f9273bb356)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:44.559349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d0311-eb75-4e77-b5d0-50bac649cd51 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:44.575769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 611/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:13:44 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/8f966288c77849f1b591bd3fc8fbd8fc/roles/6b01e46d2f154d92b9d4d0f9273bb356 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:13:46.668634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0900-3b76-459f-aa51-98b1e04f0900 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:46.669368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0900-3b76-459f-aa51-98b1e04f0900 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:46.669368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0900-3b76-459f-aa51-98b1e04f0900 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:46.670723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 622/1233] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:13:46.676847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:46.677291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:46.678147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:46.695521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:46.697119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:46.774296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 612/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:13:47.078843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a0900-3b76-459f-aa51-98b1e04f0900 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:47.106397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:47.190929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a0900-3b76-459f-aa51-98b1e04f0900 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:47.232984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:47.234535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:47.234780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:47.235063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:47.246487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:13:47.251286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:47.252358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:47.253449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 623/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:47.258896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:47.310173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:47.374077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45483f-5a25-4fd5-99d0-6e3fb59e1c44 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:47.414790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:47.415442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:47.415805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:47.415992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:47.416660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:47.416957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:47.418345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:47.432289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 613/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:47.433734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:47.535568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:47.553219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4453349-33b8-427d-a060-8fb8a1e25ab8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:47.590883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181454-9061-4291-8971-11928efc9498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:47.591669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181454-9061-4291-8971-11928efc9498 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:47.591969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181454-9061-4291-8971-11928efc9498 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:47.592239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181454-9061-4291-8971-11928efc9498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:47.604227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c181454-9061-4291-8971-11928efc9498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:47.605690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c181454-9061-4291-8971-11928efc9498 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5c181454-9061-4291-8971-11928efc9498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:47.620699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:47.621828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:47.622783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:47.622783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:47.622783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:47.622783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 624/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:47.628035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:47.735314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb179e-3989-48f8-89ba-fa4c90c933d0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:47.746196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:47.773352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:47.773963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:47.774239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:47.774508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:47.775171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:47.775503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:47.776877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:47.788837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 614/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:47.794813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181454-9061-4291-8971-11928efc9498 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:47.909143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181454-9061-4291-8971-11928efc9498 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:47.945750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:47.946757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:47.947135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:47.947501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:47.951680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:47.959117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:47.961698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:13:47.974918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:47.976664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:47.978122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 625/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:47.982483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:48.092463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e99-4b10-4325-aba3-821616894510 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:48.129403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:48.130020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:48.130295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:48.130560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:48.131316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:48.131619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:48.133109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:48.151800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 615/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:13:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:48.158123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:48.269324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aacdd-fbb5-489a-a829-3e52e593da2d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:48.309216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:48.310013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:48.310394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:48.310703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:48.380426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:48.388508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:48.390157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:48.505558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 626/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:13:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:13:48.512128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:48.545498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:48.635177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088912ba-96c1-487d-bfdd-addd5190d8fc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:48.671921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:48.672588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:48.672862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:48.673128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:48.685249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:48.686898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:48.703872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:48.705078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:48.706172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:48.706172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:48.706172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:48.706172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 616/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:48.712690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:48.823736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:48.831340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281590e2-bbbf-4460-ae4e-2f6846abc250 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:48.870488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:48.871093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:48.871398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:48.871672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:48.872309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:48.872614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:48.873980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:48.885649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 627/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:48.891508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:48.982065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:49.013114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969230-f29d-4239-8eae-5a8199283673 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:49.053687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:49.054545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:49.054839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:49.055139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:49.062227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:49.063719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:13:49.075807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:49.076827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:49.077870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 617/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:49.083149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:49.193102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c92a-572f-414f-b1df-73f663dde4a4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:49.233485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:49.234147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:49.234471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:49.234722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:49.235444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:49.235747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:49.237186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b896-ab5c-4c14-9157-825b05a11046 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:49.250238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 628/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:49.256773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:49.374471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b06be-b224-4b9a-8451-dfedc5bb9674 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:49.411510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:49.412411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:49.412684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:49.412948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:49.413747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] RBAC: Adding query filter params (role.id=6b01e46d2f154d92b9d4d0f9273bb356, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8f966288c77849f1b591bd3fc8fbd8fc) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:49.414184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:49.415895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7f06-8728-4a9f-9620-893226dc66f7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:49.422440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 618/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:13:49 2022] GET /identity/v3/role_assignments?user.id=8f966288c77849f1b591bd3fc8fbd8fc&scope.project.id=1920309f691847578cad8f735480b42c&role.id=6b01e46d2f154d92b9d4d0f9273bb356 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:51.439541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24faa-4c64-45d6-87db-baeba71116bf None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:51.440097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24faa-4c64-45d6-87db-baeba71116bf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:51.440097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24faa-4c64-45d6-87db-baeba71116bf None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:51.441513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 629/1247] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:13:51.447397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:51.447898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:51.447898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:51.455003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:51.470853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:51.472160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:51.550074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 619/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 05:13:51.826068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f24faa-4c64-45d6-87db-baeba71116bf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:51.845838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:51.942895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f24faa-4c64-45d6-87db-baeba71116bf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:51.986792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:51.987494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:51.987824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:51.988292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.001487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:13:52.008384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:52.009540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:52.010641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 630/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:52.016815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:52.125736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87870d6c-6ed3-4b4c-892a-80834fc02cd2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:52.159798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:52.165780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:52.166492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:52.166766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:52.167030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.167827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:52.168125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:52.169622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:52.179233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 620/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:52.185806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:52.277102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:52.302869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7eb13-b88e-475f-8319-c7a177b5994a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:52.341829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:52.342476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:52.342788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:52.343058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.355329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:52.356941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:52.375698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:52.377203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:52.378428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:52.378428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:52.378428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:52.378818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 631/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:13:52.385067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:52.496571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc0595-513b-4472-81b2-fe341539312f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:52.530598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:52.531261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:52.531514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:52.531790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.532426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:52.532739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:52.534224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:52.547122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 621/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:52.553260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:52.671991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd673ac-ffb0-4f37-b508-8e57bd76922d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:52.703888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:52.714675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:52.715515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:52.715830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:52.716134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.725358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:52.727158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:13:52.739283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:52.740770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:52.742399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 632/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:52.746884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:52.807036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:52.853987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2724b-f873-4c42-a8b3-6744ce99768e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:52.890420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:52.890992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:52.891284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:52.891548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:52.892265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:52.892561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:52.893990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:52.911936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 622/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:52.918540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:53.047729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813eefa-6350-4031-8e45-25d234f73aeb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:53.082395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:53.083115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:53.083450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:53.083699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:53.143892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:53.158394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:53.159891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:53.271588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 633/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:13:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 05:13:53.277636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:53.388288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb90705-75bd-447f-b1ec-b4d801a7b19c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:53.402407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:53.423683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:53.424316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:53.424586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:53.424858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:53.436219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:53.438145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:53.453287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:53.454614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:53.455888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:53.455888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:53.455888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:53.455888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 623/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:53.462946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:53.561247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:53.576593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484ac3-ada7-401c-a392-b1e9e1211c81 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:53.612785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:53.613375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:53.613648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:53.613916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:53.614557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:53.614842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:53.617129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:53.631016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 634/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:53.638516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:53.752152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8ddd-78dc-4a41-8ab4-b4e2b02b3d18 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:53.788149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:53.788879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:53.789165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:53.789469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:53.796614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:53.798264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:13:53.810146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:53.811261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:13:53.812332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 624/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:53.817348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:53.922047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017cbe-8fb0-4eb5-89bf-e49ad11cf370 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:53.961895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:53.962678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:53.963105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:53.963504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:53.964224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:53.964531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:53.966130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb11b48-72bb-42df-9b50-25f4fe0ac290 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:53.979858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 635/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:53.988151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:54.021521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:54.103932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785689-abf9-4dd6-b69c-b51e3208994c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:54.141541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:54.142368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:54.142654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:54.142955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:54.143823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8f966288c77849f1b591bd3fc8fbd8fc) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:54.144395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:54.146105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65037-f0d1-49bd-8cd6-336e03023756 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:54.153007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 625/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:13:53 2022] GET /identity/v3/role_assignments?user.id=8f966288c77849f1b591bd3fc8fbd8fc&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:56.063929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b09da-ecb8-4908-8989-00f660d3d92b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:56.064784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b09da-ecb8-4908-8989-00f660d3d92b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:56.064784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b09da-ecb8-4908-8989-00f660d3d92b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:56.066864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 636/1261] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:13:56.072618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:56.073059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:56.073162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:56.093105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:13:56.094304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:13:56.169939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 626/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:13:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:13:56.439189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b09da-ecb8-4908-8989-00f660d3d92b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:56.453523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:56.551117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b09da-ecb8-4908-8989-00f660d3d92b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:56.586795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:56.587440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:56.587712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:56.587973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:56.598284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:13:56.603142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:56.604229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:56.605145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 637/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:56.613002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:56.635473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:56.722979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836facf-ef36-4bb4-bea1-ff2740fed393 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:56.759927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:56.760526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:56.760809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:56.761047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:56.761703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:56.761996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:56.763390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:56.771578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 627/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:56.778442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:56.857698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:56.892907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac605-cb24-4c66-b452-4d1b4862bbea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:56.928231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:56.928845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:56.929165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:56.929442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:56.939703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:56.941183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:56.959774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:56.960958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:56.961930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:56.961930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:56.961930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:56.961930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 638/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:56.968936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.066678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:57.089366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9423-fcfb-425b-834b-2e29108058cf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.129470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.130075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.130347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.130607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:57.131242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:57.131546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:57.132950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:57.144702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 628/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:13:57.151168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.253244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3477bfc-87e9-45fb-8f17-bbdc1ec11ebf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.273207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:57.296533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.297432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.297806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.298150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:57.308089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:57.309525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:13:57.320885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:57.321947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:57.322900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 639/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:13:57.327806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.433533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feabddd-16af-43e4-873d-86be7a2ff155 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.472412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.473025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.473300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.473563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:57.474288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:57.474583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:57.476114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:57.485935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:57.495324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 629/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:13:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:57.501302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.604763 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d917-6faa-45b9-bb78-5a358a5a581a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.644044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.644674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.644954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.645222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:57.656446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:57.657885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:13:57.672492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:57.673563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:13:57.674605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:13:57.674605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:13:57.674605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:57.675557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 640/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:57.679560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.784283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6ee-16f6-4208-8f92-b208a6d2a1b0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.820282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.820878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.821155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.821426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:57.822061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:57.822359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:57.823766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:57.835171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 630/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:57.841865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:57.880595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:57.954819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c2c8-39e3-4f13-aa90-7553fd1ac9b1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:57.996914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:57.997548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:57.997822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:57.998089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:58.004945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:58.006379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:13:58.017819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:13:58.018866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:13:58.019997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 641/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:13:58.025414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:58.089819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:58.136802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28433a0c-79ee-427a-980d-f385bdfc205f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:58.172529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:58.173131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:58.173361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:58.173663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:58.174346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:13:58.174645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:58.176120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23598d-6f74-4370-bc22-d82adaa2cc19 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:58.188508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 631/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:13:58.195338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:13:58.292458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:13:58.306049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1edbc5-0bc0-4528-a9c3-6fc4a5a40757 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:13:58.341017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:13:58.341668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:13:58.341940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:13:58.342204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] PATH_INFO: `/v3/projects/1920309f691847578cad8f735480b42c/users/8f966288c77849f1b591bd3fc8fbd8fc/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:13:58.344272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=1920309f691847578cad8f735480b42c, user_id=8f966288c77849f1b591bd3fc8fbd8fc, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:13:58.345697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9dedf-442f-4cde-b9c9-58ce34223b54 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:13:58.365219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 642/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Sep 2 05:13:58 2022] PUT /identity/v3/projects/1920309f691847578cad8f735480b42c/users/8f966288c77849f1b591bd3fc8fbd8fc/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:14:00.245032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf5e0-4750-47de-ade0-796f78d84353 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:00.245693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf5e0-4750-47de-ade0-796f78d84353 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:00.245693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf5e0-4750-47de-ade0-796f78d84353 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:00.246911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 632/1274] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:14:00.253469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:00.254230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:00.254382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:00.276354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:14:00.277541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:14:00.357849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 643/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:14:00.621252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf5e0-4750-47de-ade0-796f78d84353 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:00.729739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf5e0-4750-47de-ade0-796f78d84353 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:00.747488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:00.765966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:00.766588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:00.766857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:00.767109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:00.778098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 05:14:00.782808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:00.783954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:00.784852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 633/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Sep 2 05:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:00.790220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:00.877264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:00.899739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003271c8-5c4e-4eb7-a3c6-cd07f0b2c62a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:00.936166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:00.936769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:00.937049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:00.937317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:00.937983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:00.938289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:00.939699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:00.948188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 644/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Sep 2 05:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:00.954381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:01.066815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329612-ed38-4b07-98ab-9109ad7490d2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:01.102802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:01.103455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:01.103729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:01.103982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:01.114220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:01.116014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:14:01.130741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:01.131890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:14:01.132989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:14:01.132989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:14:01.132989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:01.132989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 634/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:01.141108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:01.245556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8940075-707c-46dd-837a-33e4bad89bf1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:01.280982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:01.281600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:01.281845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:01.282116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:01.282758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:01.283063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:01.284451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:01.296290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 645/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:01.302205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:01.335966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:01.420057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f213-92cd-4563-88ef-32d3c216bd0e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:01.456677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:01.457186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:01.457462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:01.457728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:01.466169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:01.467646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 05:14:01.479658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:01.480744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:01.481887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 635/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:14:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 05:14:01.486895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:01.491143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:01.596323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e50b-c673-4f8c-8692-20b8f0ed045b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:01.632129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:01.632727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:01.633004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:01.633274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:01.633991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:01.634296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:01.635758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:01.652945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 646/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Sep 2 05:14:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:14:01.659734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:01.759151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:01.770006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72108e4-1925-4360-80d6-28ff98227b4b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:01.804944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:01.805532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:01.805805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:01.806073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:01.875312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:01.876760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:01.979453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:01.989653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 636/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Sep 2 05:14:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 05:14:01.995977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:02.059695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:02.099911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c2fc1-512f-4c98-9b80-bfea269d37d2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:02.136203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:02.136830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:02.137106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:02.137370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:02.147801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:02.149383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 05:14:02.164250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:02.165325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 05:14:02.166686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 05:14:02.166686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 05:14:02.166686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:14:02.166686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 647/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:02.174659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:02.285625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dbec9-a6e4-4457-a729-2926c3625908 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:02.324104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:02.324715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:02.324896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:02.325165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:02.325799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:02.326072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:02.327484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:02.339497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 637/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Sep 2 05:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:02.345497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:02.455600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946e727-b6bf-41fc-8c2d-7642b187bc18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:02.469592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:02.491988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:02.492667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:02.492952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:02.493251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:02.500634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:02.502100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 05:14:02.514085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:02.515104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Sep 02 05:14:02.516245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 648/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Sep 2 05:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:02.521401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:02.573576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:02.628738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28361-30b1-46dd-8a7e-fb534540fb23 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:02.666600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:02.667229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:02.667500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:02.667769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:02.668440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:02.668739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:02.670175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f4af-f9ac-4017-a3f8-74a75f3bb334 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:02.682466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 638/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Sep 2 05:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:02.688909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:02.792346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc096-9764-4ca8-a53f-a4bf251015c7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:02.827014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:02.827631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:02.827916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:02.828136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:02.828880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] RBAC: Adding query filter params (role.id=043be44598c24b52b429eb2a25c1962d, scope.project.id=1920309f691847578cad8f735480b42c, user.id=8f966288c77849f1b591bd3fc8fbd8fc) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:02.829182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:02.830587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac0e5-2583-46d4-a1f7-4564d62ce158 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:02.836560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 649/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Sep 2 05:14:02 2022] GET /identity/v3/role_assignments?user.id=8f966288c77849f1b591bd3fc8fbd8fc&scope.project.id=1920309f691847578cad8f735480b42c&role.id=043be44598c24b52b429eb2a25c1962d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:04.743270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614f9f-e02b-4db1-97ed-3c68e4a71192 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:04.743843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614f9f-e02b-4db1-97ed-3c68e4a71192 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:04.743843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614f9f-e02b-4db1-97ed-3c68e4a71192 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:04.745194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 639/1288] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:14:04.751715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:04.752434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:04.752638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:04.774924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:14:04.776136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:14:04.809076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:04.848481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 650/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:14:05.112206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d614f9f-e02b-4db1-97ed-3c68e4a71192 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:05.233139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d614f9f-e02b-4db1-97ed-3c68e4a71192 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:05.243986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:05.269713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:05.270331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:05.270602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:05.270870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:05.271462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:05.272872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:05.281517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:05.282663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:05.283604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 640/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:14:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:05.289004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:05.402080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7d3fe-75f8-4dd6-a9ed-2767a1111862 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:05.438014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:05.438619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:05.438899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:05.439169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:05.439835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:05.440131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:05.441502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64a90-0a0a-49e2-a385-e0ec6de9862c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:05.446963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 651/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Sep 2 05:14:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:14:05.453087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:05.559966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cdd54-290f-42ea-afe9-56311007dba9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:05.594810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:05.595449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:05.595724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:05.595990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:05.596615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:05.596908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:05.598288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740868-ab7f-41c3-8e56-6295743e3727 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:05.602986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 641/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Sep 2 05:14:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:07.438234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32503-8180-4b1f-9046-c2ba5434ab26 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:07.439131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32503-8180-4b1f-9046-c2ba5434ab26 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:07.439131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32503-8180-4b1f-9046-c2ba5434ab26 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:07.441292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 652/1293] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:14:07.447984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1d14-5692-4796-a981-1c3ae8073a5d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:07.448380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1d14-5692-4796-a981-1c3ae8073a5d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:07.448556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1d14-5692-4796-a981-1c3ae8073a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:07.469010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-387b1d14-5692-4796-a981-1c3ae8073a5d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:14:07.470252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-387b1d14-5692-4796-a981-1c3ae8073a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:14:07.509197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:07.549987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 642/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:14:07.810454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f32503-8180-4b1f-9046-c2ba5434ab26 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:07.861500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:07.935442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f32503-8180-4b1f-9046-c2ba5434ab26 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:07.971584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:07.972195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:07.972474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:07.972744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:07.973426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:07.974802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97124-3d79-4009-942c-62e5f0c76ebe None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:07.991527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 653/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Sep 2 05:14:07 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:14:09.918329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7355-6e5d-49c1-8a1e-22e4c4b77e08 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:09.919171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7355-6e5d-49c1-8a1e-22e4c4b77e08 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:09.919171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f7355-6e5d-49c1-8a1e-22e4c4b77e08 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:09.921403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 643/1296] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:14:09.926741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:09.927177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:09.927307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:09.948338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:14:09.949613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:14:10.028017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 654/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:14:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:14:10.299089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f7355-6e5d-49c1-8a1e-22e4c4b77e08 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:10.428672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f7355-6e5d-49c1-8a1e-22e4c4b77e08 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:10.467676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:10.468311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:10.468580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:10.468844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:10.469410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:10.470792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:10.480975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:10.481952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:10.482852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 644/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:14:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:10.488583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:10.508835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:10.602880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f895-3901-46a0-858e-db105fbe37ba None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:10.639580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:10.640176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:10.640474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:10.640714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:10.641337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:10.641633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:10.642995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:10.648316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 655/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Sep 2 05:14:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:14:10.654572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:10.687166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:10.758375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97d8b-da30-421e-a09a-550eff881ccf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:10.793120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:10.793709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:10.793980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:10.794242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:10.794928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] RBAC: Adding query filter params (interface=public, service_id=534ec17ddb5f4207b2709884f0ddc1b5, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:10.795242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:10.796615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569f34-b6ba-43fb-b8e1-c6d28faecba9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:10.801693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 645/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Sep 2 05:14:10 2022] GET /identity/v3/endpoints?service_id=534ec17ddb5f4207b2709884f0ddc1b5&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:10.808282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:10.912177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:10.934571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1b95-7fd4-453f-b40b-4c791d940639 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:10.970826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:10.971453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:10.971730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:10.972002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:10.972600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:10.973967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29086-f84c-43e6-a14b-8222161091bc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:10.980819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 656/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Sep 2 05:14:10 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:14:12.828862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78337c0-7ae8-4dff-89ed-9276a894c0cb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:12.829418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78337c0-7ae8-4dff-89ed-9276a894c0cb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:12.829418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78337c0-7ae8-4dff-89ed-9276a894c0cb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:12.830732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 646/1302] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:14:12.837153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:12.837838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:12.838018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:12.861973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:14:12.863181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:14:12.936772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 657/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:14:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 05:14:13.200681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78337c0-7ae8-4dff-89ed-9276a894c0cb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:13.308558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:13.319075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78337c0-7ae8-4dff-89ed-9276a894c0cb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:13.362426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:13.363045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:13.363362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:13.363625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:13.364191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:13.366011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 05:14:13.375539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 05:14:13.376640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Sep 02 05:14:13.377478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 647/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Sep 2 05:14:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 05:14:13.385039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:13.465217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:13.493555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c655f1-2bc5-445e-b27d-9e4045d983e9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:13.532371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:13.533311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:13.533745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:13.534145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:13.535144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:14:13.535669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:13.537883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74241d1-c8e9-46fe-b063-cee14a969339 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:13.543751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 658/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Sep 2 05:14:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:14:13.550405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:14:13.663055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47729de7-9df4-4551-ade3-25602f0b6908 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:14:13.701335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:14:13.701924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:14:13.702198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:14:13.702464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:14:13.703119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:14:13.704530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509dd9-e833-4481-b3f4-734f2d2064f5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:14:13.728190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 648/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:14:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:14:23.540179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=30 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:14:23.723267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:18.129262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f8da-f89e-4944-97af-5081952623d8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:18.130317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f8da-f89e-4944-97af-5081952623d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:18.130934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f8da-f89e-4944-97af-5081952623d8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:18.132588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 659/1307] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:18.138210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914647bc-2c75-49e8-8bbe-720d6dcf2888 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:18.139002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914647bc-2c75-49e8-8bbe-720d6dcf2888 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:18.139471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914647bc-2c75-49e8-8bbe-720d6dcf2888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:18.295236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-914647bc-2c75-49e8-8bbe-720d6dcf2888 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:18.296611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-914647bc-2c75-49e8-8bbe-720d6dcf2888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:18.483817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 649/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:18.792744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:18.793312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:18.793745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:18.795593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 660/1309] 10.222.0.26 () {54 vars in 965 bytes} [Fri Sep 2 05:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:18.802081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7593-d3df-4b43-a998-d1415081b095 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:18.802955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7593-d3df-4b43-a998-d1415081b095 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:18.802955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7593-d3df-4b43-a998-d1415081b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:18.899304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-28cc7593-d3df-4b43-a998-d1415081b095 None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:18.901046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-28cc7593-d3df-4b43-a998-d1415081b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:18.925726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:19.015260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:19.017324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:19.022676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 650/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Sep 2 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:19.159470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00db80b-bb1d-4422-83fe-959b3c00dda4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:19.237628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:19.238560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:19.238837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:19.239107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:19.240969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:19.299362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:19.358055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:19.359539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f22175-c814-4943-bb92-8ecf7c67964a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:19.379581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 661/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:15:21.598847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:21.599457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:21.599457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:21.600761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 651/1312] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:21.606013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261baacb-92a5-4595-aa34-4c99c060bc07 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:21.606430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261baacb-92a5-4595-aa34-4c99c060bc07 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:21.606544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261baacb-92a5-4595-aa34-4c99c060bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:21.694102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-261baacb-92a5-4595-aa34-4c99c060bc07 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:21.695372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-261baacb-92a5-4595-aa34-4c99c060bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:21.799509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 662/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:22.077942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:22.079714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:22.208200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43086d-fede-4ac1-8a12-3341cbb4b235 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:22.285863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:22.288502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:22.289105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:22.289350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:22.289661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:22.291879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:22.406804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:22.408201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7fb3-5e7b-426a-bd68-3dd2b489969e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:22.427192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 652/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:24.643481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:24.644374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:24.644374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:24.647009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 663/1315] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:24.653246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee785adc-ee83-4e0f-acd1-9e08307b2df9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:24.653967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee785adc-ee83-4e0f-acd1-9e08307b2df9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:24.654142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee785adc-ee83-4e0f-acd1-9e08307b2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:24.727244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ee785adc-ee83-4e0f-acd1-9e08307b2df9 None None] MFA Rules not processed for user `7a13bfb8ac1e4509aab08b1d7a9cf762`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:24.728469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee785adc-ee83-4e0f-acd1-9e08307b2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:24.783357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:24.830390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 653/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:25.110477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:25.113386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:25.129337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:25.231942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade203f-bd59-485a-af5b-159979580b2e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:25.309517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:25.310123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:25.310402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:25.310670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:25.312301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:25.388760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:25.449884 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:25.451360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55915-fffc-4a4d-894f-9a706d3b62d2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:25.474959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 664/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:27.918332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:27.918909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:27.918909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:27.920267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 654/1318] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:27.926617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df60abb-df87-4ddf-9bf7-b40ad789efb6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:27.927316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df60abb-df87-4ddf-9bf7-b40ad789efb6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:27.927621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df60abb-df87-4ddf-9bf7-b40ad789efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:28.004132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1df60abb-df87-4ddf-9bf7-b40ad789efb6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:28.005358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1df60abb-df87-4ddf-9bf7-b40ad789efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:28.104816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 665/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:28.390633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:28.392203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:28.501895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2a66f-7da4-467e-9a9e-68e33dddb106 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:28.582831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:28.583469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:28.583739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:28.584000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:28.585616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:28.592760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:28.708759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:28.710137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f21be-045e-4861-9209-c4282cb923c6 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:28.729261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 655/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:15:31.398064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:31.398633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:31.398963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:31.400481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 666/1321] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:15:31.406437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76598c9-786c-4e21-acd9-42ed9dd049de None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:31.406937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76598c9-786c-4e21-acd9-42ed9dd049de None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:31.406937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76598c9-786c-4e21-acd9-42ed9dd049de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:31.482929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a76598c9-786c-4e21-acd9-42ed9dd049de None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:31.484170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a76598c9-786c-4e21-acd9-42ed9dd049de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:31.545547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:31.585871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 656/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:31.868971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:31.870566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:31.890561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:31.980450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0834c-9184-4e78-b10e-79ed3c5598c3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:32.060133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:32.060609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:32.060889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:32.061157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:32.062751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:32.137559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:32.176879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:32.178319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e948fd9-edeb-44b1-8751-a1f672d6943a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:32.196881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 667/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:34.144204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502129-cc85-4de9-8764-b5c4de4b3e78 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:34.144761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502129-cc85-4de9-8764-b5c4de4b3e78 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:34.144761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502129-cc85-4de9-8764-b5c4de4b3e78 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:34.146493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 657/1324] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:34.151936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562780-6ed2-40e6-9fbd-5ef3bbd2a425 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:34.152406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562780-6ed2-40e6-9fbd-5ef3bbd2a425 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:34.152500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562780-6ed2-40e6-9fbd-5ef3bbd2a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:34.221105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d2562780-6ed2-40e6-9fbd-5ef3bbd2a425 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:34.222306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2562780-6ed2-40e6-9fbd-5ef3bbd2a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:34.324526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 668/1325] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:34.621243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:34.621508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:34.621769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:34.623183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 658/1326] 10.222.0.26 () {54 vars in 965 bytes} [Fri Sep 2 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:34.629173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2e61-115e-4352-8bfe-0c5effa33f25 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:34.629561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2e61-115e-4352-8bfe-0c5effa33f25 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:34.629838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2e61-115e-4352-8bfe-0c5effa33f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:34.662142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:34.717768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-928c2e61-115e-4352-8bfe-0c5effa33f25 None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:34.718989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-928c2e61-115e-4352-8bfe-0c5effa33f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:34.799230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 669/1327] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Sep 2 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:34.808520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:34.810130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:34.927455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e57b-1698-4323-a0dc-00ac3fb98f59 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:35.006516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:35.007047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:35.007350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:35.007615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:35.009201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:35.030397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:35.127023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:35.128512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059dec2-9b11-4f2e-bfb0-d6a52c5c3f35 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:35.148375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 659/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:37.314319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:37.314848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:37.314848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:37.317188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 670/1329] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:37.321871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90594a8-46bb-4131-8547-007f4eafc1be None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:37.322373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90594a8-46bb-4131-8547-007f4eafc1be None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:37.322472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90594a8-46bb-4131-8547-007f4eafc1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:37.393299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c90594a8-46bb-4131-8547-007f4eafc1be None None] MFA Rules not processed for user `7a13bfb8ac1e4509aab08b1d7a9cf762`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:37.394507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c90594a8-46bb-4131-8547-007f4eafc1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:37.470326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:37.506369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 660/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:37.791955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:37.793519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:37.917609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b49a-bdd5-4983-9c42-2500a13b1aeb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:37.942001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:38.001465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:38.002090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:38.002371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:38.002641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:38.004546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:38.123878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:38.125585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad987bf-2422-4bca-8abe-aea7ca02dfc4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:38.146591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 671/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:40.274405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:40.275296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:40.275296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:40.277482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 661/1332] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:40.283775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d0d52-d599-4f56-8554-02324fa796b8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:40.284569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d0d52-d599-4f56-8554-02324fa796b8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:40.284721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d0d52-d599-4f56-8554-02324fa796b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:40.354040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:40.357575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-284d0d52-d599-4f56-8554-02324fa796b8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:40.359556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-284d0d52-d599-4f56-8554-02324fa796b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:40.461285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 672/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:40.761976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:40.764507 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:40.886272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f53ff-eb9b-49d8-92f7-684aedc4b5ee None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:40.967276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:40.967891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:40.968161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:40.968430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:40.970058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:40.998435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:41.089027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:41.090386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0dbf3-0063-4b05-b942-88a622bb2865 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:41.116031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 662/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:43.042054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:43.042624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:43.042624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:43.043928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 673/1335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:43.049336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160390b-76a6-44b5-ac8d-197963785050 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:43.049789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160390b-76a6-44b5-ac8d-197963785050 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:43.049900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160390b-76a6-44b5-ac8d-197963785050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:43.121264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7160390b-76a6-44b5-ac8d-197963785050 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:43.122468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7160390b-76a6-44b5-ac8d-197963785050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:43.208307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:43.232828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 663/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:43.512348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:43.513956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:43.630717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15e11-5b2b-4ad4-9668-f1f5070fee45 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:43.664819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:43.712725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:43.713322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:43.713592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:43.713851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:43.715452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:43.833177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:43.834655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89890001-cb5e-4fc2-abdb-1493bccfee1c service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:43.853758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 674/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:15:46.392292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:46.393157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:46.393157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:46.395496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 664/1338] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:46.400809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445024f8-eb89-4842-9dac-cc27b2139022 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:46.401257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445024f8-eb89-4842-9dac-cc27b2139022 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:46.401357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445024f8-eb89-4842-9dac-cc27b2139022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:46.474116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-445024f8-eb89-4842-9dac-cc27b2139022 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:46.475389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-445024f8-eb89-4842-9dac-cc27b2139022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:46.484125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:46.581264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 675/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:46.865224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:46.867763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:46.990908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844901d-7e94-40be-88f2-2b1bdd233b79 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:47.072103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:47.072717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:47.072976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:47.073263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:47.074856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:47.118856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:47.203423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:47.204898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22ef1d-8423-45ef-91e7-34bebe32cf0c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:47.225855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 665/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:51.207050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:51.207604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:51.207854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:51.209192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 676/1341] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:51.214648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca594-df12-4b74-94fe-bc52a493d07b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:51.215079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca594-df12-4b74-94fe-bc52a493d07b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:51.215186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca594-df12-4b74-94fe-bc52a493d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:51.283701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2d5ca594-df12-4b74-94fe-bc52a493d07b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:51.284772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2d5ca594-df12-4b74-94fe-bc52a493d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:51.375836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:51.388591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 666/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:51.667687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:51.669300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:51.779706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1eac4-70d8-4cfe-9fc8-5ed48e60d123 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:51.829196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:51.868637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:51.869254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:51.869534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:51.869806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:51.871429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:51.986246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:51.988351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4a71b-7d0a-40ab-83eb-fe2c621b7508 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:52.007336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 677/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:54.560186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:54.560718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:54.560718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:54.562160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 667/1344] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:54.568510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2455-2d0b-4118-adaf-fcae6f0d0523 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:54.569071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2455-2d0b-4118-adaf-fcae6f0d0523 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:54.569071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2455-2d0b-4118-adaf-fcae6f0d0523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:54.636764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d3fc2455-2d0b-4118-adaf-fcae6f0d0523 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:54.637980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d3fc2455-2d0b-4118-adaf-fcae6f0d0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:54.657004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:54.740835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 678/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:55.021130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:55.022687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:55.135223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98b90-e434-4e53-8491-2818d4c60740 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:55.218273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:55.218895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:55.219165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:55.219459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:55.221149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:55.268466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:55.350983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:15:55.352481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa813fb4-b260-44ef-9490-f5aaeb173cdc service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:15:55.371969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 668/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:15:59.278918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:59.279474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:59.279474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:59.280862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 679/1347] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:15:59.286913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3af2a-6582-4acb-834f-715fb01a3edd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:59.287494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3af2a-6582-4acb-834f-715fb01a3edd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:59.287494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3af2a-6582-4acb-834f-715fb01a3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:59.365134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3ed3af2a-6582-4acb-834f-715fb01a3edd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:15:59.366415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ed3af2a-6582-4acb-834f-715fb01a3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:59.472811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:59.479988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 669/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:15:59.755178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:15:59.756806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:15:59.876031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9da44e-1610-475e-9d96-902fca2598d7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:15:59.928071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:15:59.955690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:15:59.956890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:15:59.956890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:15:59.957180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:15:59.958910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:00.072395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:00.073956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5cde6-045b-4232-bace-cae8cc25b875 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:00.092676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 680/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:04.942800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cbfb-4ab8-4be6-b428-2701b168e474 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:04.943405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cbfb-4ab8-4be6-b428-2701b168e474 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:04.943405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cbfb-4ab8-4be6-b428-2701b168e474 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:04.944938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 670/1350] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:04.950127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f645b-d0bb-424a-9e79-0757029a632c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:04.950973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f645b-d0bb-424a-9e79-0757029a632c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:04.951492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f645b-d0bb-424a-9e79-0757029a632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:05.051311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a39f645b-d0bb-424a-9e79-0757029a632c None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:05.052498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a39f645b-d0bb-424a-9e79-0757029a632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:05.071768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:05.214335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 681/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:09.376371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ffe4-5bd6-4967-a9b5-66dd186e1021 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:09.376919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ffe4-5bd6-4967-a9b5-66dd186e1021 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:09.376919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ffe4-5bd6-4967-a9b5-66dd186e1021 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:09.378840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 671/1352] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:09.383965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aae17-f326-497e-b3fd-c16ba696e881 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:09.384784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aae17-f326-497e-b3fd-c16ba696e881 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:09.385302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aae17-f326-497e-b3fd-c16ba696e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:09.477494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-023aae17-f326-497e-b3fd-c16ba696e881 None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:09.479091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-023aae17-f326-497e-b3fd-c16ba696e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:09.557846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:09.597401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 682/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:16:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:10.863152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e92d4-1ade-4eb9-ab23-725eb0d91841 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:10.863878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e92d4-1ade-4eb9-ab23-725eb0d91841 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:10.863878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e92d4-1ade-4eb9-ab23-725eb0d91841 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:10.865406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 672/1354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:10.870525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365612-aae4-40eb-9a9b-0d63a66d3f23 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:10.870978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365612-aae4-40eb-9a9b-0d63a66d3f23 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:10.871074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365612-aae4-40eb-9a9b-0d63a66d3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:10.947963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d6365612-aae4-40eb-9a9b-0d63a66d3f23 None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:10.949170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d6365612-aae4-40eb-9a9b-0d63a66d3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:11.058125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 683/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:16:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:14.404597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490954-65c2-490e-9adf-378b58ed71c8 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:14.405193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490954-65c2-490e-9adf-378b58ed71c8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:14.405193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490954-65c2-490e-9adf-378b58ed71c8 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:14.406460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 673/1356] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:14.412013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c711-ca7e-4e5c-a63b-ae2045030373 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:14.412458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c711-ca7e-4e5c-a63b-ae2045030373 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:14.412554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c711-ca7e-4e5c-a63b-ae2045030373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:14.456235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:14.499223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a9d7c711-ca7e-4e5c-a63b-ae2045030373 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:14.500413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a9d7c711-ca7e-4e5c-a63b-ae2045030373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:14.623304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 684/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:14.929573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:14.929856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:14.930124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:14.931952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 674/1358] 10.222.0.26 () {54 vars in 962 bytes} [Fri Sep 2 05:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:14.943253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549dcb-8582-4e6a-8fc6-37179f871589 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:14.943648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549dcb-8582-4e6a-8fc6-37179f871589 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:14.944021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549dcb-8582-4e6a-8fc6-37179f871589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:15.033585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a4549dcb-8582-4e6a-8fc6-37179f871589 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:15.035432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4549dcb-8582-4e6a-8fc6-37179f871589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:15.086643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:15.164342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 685/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Sep 2 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:16:15.172313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:15.174077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:15.338676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73e15-3428-4cec-a235-3b06b315504b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:15.424803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:15.469049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:15.469675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:15.469951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:15.470262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:15.472005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:15.572654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:15.574458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561069b5-6280-4214-aacf-4307cd201de4 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:15.593712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 675/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:17.697229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:17.697613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:17.697613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:17.702731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 686/1361] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:17.704360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a1fb-b0bf-4d49-8257-ac21fa3b18fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:17.704835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a1fb-b0bf-4d49-8257-ac21fa3b18fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:17.704925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a1fb-b0bf-4d49-8257-ac21fa3b18fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:17.785401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-baa8a1fb-b0bf-4d49-8257-ac21fa3b18fe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:17.786606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-baa8a1fb-b0bf-4d49-8257-ac21fa3b18fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:17.831091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:17.899310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 676/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:18.182638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:18.183592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:18.346511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f69f-5351-405b-aa13-600a91902a1d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:18.356486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:18.473934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:18.474557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:18.474842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:18.475112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:18.476903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:18.576504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:18.578144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed15b4a-d20f-4c48-828a-9268e3dedcb7 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:18.610774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 687/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:20.816889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb093c5-2106-4339-8303-5aa1b99b4365 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:20.817408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb093c5-2106-4339-8303-5aa1b99b4365 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:20.817408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb093c5-2106-4339-8303-5aa1b99b4365 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:20.818996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 677/1364] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:20.824460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d37c-57d9-40ed-b954-042232643f4b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:20.824922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d37c-57d9-40ed-b954-042232643f4b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:20.825002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d37c-57d9-40ed-b954-042232643f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:20.841235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:20.896119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2fe8d37c-57d9-40ed-b954-042232643f4b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:20.897354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2fe8d37c-57d9-40ed-b954-042232643f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:21.003565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 688/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:21.283877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:21.284461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:21.285126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:21.286833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 678/1366] 10.222.0.26 () {54 vars in 962 bytes} [Fri Sep 2 05:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:21.292930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e0b6-ab31-4196-b61c-ab11850b344f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:21.293289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e0b6-ab31-4196-b61c-ab11850b344f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:21.293632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e0b6-ab31-4196-b61c-ab11850b344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:21.374272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7c34e0b6-ab31-4196-b61c-ab11850b344f None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:21.375500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c34e0b6-ab31-4196-b61c-ab11850b344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:21.413793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:21.503853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 689/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Sep 2 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:21.511671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:21.513143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:21.667527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703e108-7979-4712-b9b1-3d849bab521a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:21.689222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:21.796791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:21.797401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:21.797675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:21.797943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:21.799862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:21.898301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:21.900851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f599cfd-51eb-4620-a3d1-0325c1722e1c service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:21.926095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 679/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:22.560651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c596d-3ad3-43ac-813c-d1fa45b7808b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:22.561283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c596d-3ad3-43ac-813c-d1fa45b7808b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:22.561435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c596d-3ad3-43ac-813c-d1fa45b7808b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:22.563015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 690/1369] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:22.568304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150691a8-41b0-4b7d-8bdc-a5205e3bf017 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:22.568558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150691a8-41b0-4b7d-8bdc-a5205e3bf017 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:22.568858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150691a8-41b0-4b7d-8bdc-a5205e3bf017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:22.602392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:22.642001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-150691a8-41b0-4b7d-8bdc-a5205e3bf017 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:22.643452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-150691a8-41b0-4b7d-8bdc-a5205e3bf017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:22.759245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 680/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:23.330058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:23.330058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:23.330058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:23.332586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 691/1371] 10.222.0.26 () {54 vars in 964 bytes} [Fri Sep 2 05:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:23.335908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a5fef-6c06-483f-bcc5-abe35ff28498 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:23.336473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a5fef-6c06-483f-bcc5-abe35ff28498 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:23.336473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a5fef-6c06-483f-bcc5-abe35ff28498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:23.418622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c99a5fef-6c06-483f-bcc5-abe35ff28498 None None] MFA Rules not processed for user `c891710c74ca4a4dae183c7979152109`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:23.419884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c99a5fef-6c06-483f-bcc5-abe35ff28498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:23.480625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:23.517741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 681/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Sep 2 05:16:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:23.526183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:23.527834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:23.641051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247887-ea48-431d-8c56-cbe31e14970f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:23.688832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:23.731725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:23.732837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:23.733318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:23.733756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:23.736947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:23.871737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:23.873413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30b75-4200-4435-8965-c212cbc2c6f9 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:23.895720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 692/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:23.915514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:23.916163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:23.916800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:23.919827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 682/1374] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:23.925388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341491-c243-43bc-82ae-bee368444e5c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:23.925692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341491-c243-43bc-82ae-bee368444e5c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:23.925951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341491-c243-43bc-82ae-bee368444e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:23.995749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-12341491-c243-43bc-82ae-bee368444e5c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:23.996574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-12341491-c243-43bc-82ae-bee368444e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:24.023757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:24.103720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 693/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:16:24.464604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:24.466327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:24.632687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964a83-303e-49eb-90db-952ff49b80d5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:24.693213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:24.771092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:24.771729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:24.772001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:24.772261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:24.773834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:24.864813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:24.866409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaac3a-f56c-4886-9593-bc08209e9935 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:24.884337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 683/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:26.813125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:26.813783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:26.813783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:26.815573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 694/1377] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:26.821405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051770-a6c0-4de4-8cd2-ec075be81bce None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:26.821896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051770-a6c0-4de4-8cd2-ec075be81bce None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:26.822186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e051770-a6c0-4de4-8cd2-ec075be81bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:26.909550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5e051770-a6c0-4de4-8cd2-ec075be81bce None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:26.910772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5e051770-a6c0-4de4-8cd2-ec075be81bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:26.917681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:27.032353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 684/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:27.364068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:27.365634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:27.585651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f016e9-f0a1-4de3-a40e-bca848738b52 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:27.591447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:27.726647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:27.727391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:27.727719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:27.728052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:27.729724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:27.832830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:27.834666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1a2f5-7411-415b-926c-cdcef48fa646 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:27.854087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 695/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:29.929705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:29.929705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:29.930270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:29.933076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 685/1380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:29.936588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825bbd-0f04-40eb-9ecb-8be8b9028299 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:29.937052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825bbd-0f04-40eb-9ecb-8be8b9028299 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:29.937144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825bbd-0f04-40eb-9ecb-8be8b9028299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:29.949159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:30.006487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5f825bbd-0f04-40eb-9ecb-8be8b9028299 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:30.007724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5f825bbd-0f04-40eb-9ecb-8be8b9028299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:30.110515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 696/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:30.397240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:30.398753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:30.562850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:30.578323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02524ffc-0d74-4f5f-9391-96fddcb23d66 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:30.715165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:30.715914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:30.716256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:30.716617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:30.718400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:30.821543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:30.823155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05282-1b27-4b24-b365-f501ac944453 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:30.834364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:30.844152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 686/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:32.853936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:32.854603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:32.854603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:32.855844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 697/1383] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:32.862750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4baf4-749f-406c-aca5-ce7902df85e0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:32.863454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4baf4-749f-406c-aca5-ce7902df85e0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:32.863454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4baf4-749f-406c-aca5-ce7902df85e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:32.940255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-67c4baf4-749f-406c-aca5-ce7902df85e0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:32.941822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-67c4baf4-749f-406c-aca5-ce7902df85e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:33.060658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 687/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:33.402165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:33.403915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:33.507993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:33.592558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef78d6-85ca-4c28-986a-8684367224bf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:33.722756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:33.723424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:33.723708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:33.723980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:33.725667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:33.785310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:33.840403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:33.842539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0665b41-aa81-4fa3-9031-0d1c071b78c9 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:33.867869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 698/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:35.910961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:35.911617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:35.911712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:35.913355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 688/1386] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:35.920221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3375dc-ee6a-4464-ae1b-099bf9332cbb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:35.920690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3375dc-ee6a-4464-ae1b-099bf9332cbb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:35.920914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3375dc-ee6a-4464-ae1b-099bf9332cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:36.011363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bd3375dc-ee6a-4464-ae1b-099bf9332cbb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:36.013164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bd3375dc-ee6a-4464-ae1b-099bf9332cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:36.139410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 699/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:36.506199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:36.509528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:36.603852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:36.697720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80fa5-306e-44ef-b6ae-38a7491538ec None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:36.833748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:36.834520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:36.834860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:36.835184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:36.837292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:36.880477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:36.942893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:36.944947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952ee3-a66f-4d81-8d85-b6969e7b24c4 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:36.968401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 689/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:38.913075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc93-aaae-462f-b173-06cf77550528 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:38.913719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc93-aaae-462f-b173-06cf77550528 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:38.913719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29bc93-aaae-462f-b173-06cf77550528 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:38.914876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 700/1389] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:38.920322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940ee7-53b2-47b8-9e71-2b99a3ee97f2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:38.920780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940ee7-53b2-47b8-9e71-2b99a3ee97f2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:38.920881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940ee7-53b2-47b8-9e71-2b99a3ee97f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:38.989828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-51940ee7-53b2-47b8-9e71-2b99a3ee97f2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:38.990990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-51940ee7-53b2-47b8-9e71-2b99a3ee97f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.090692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 690/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:39.094672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.095032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.095342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.096871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 701/1391] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:39.102076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983928-751b-4b75-8035-c14526aaa76a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.102357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983928-751b-4b75-8035-c14526aaa76a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.102639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983928-751b-4b75-8035-c14526aaa76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.119025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.170063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9983928-751b-4b75-8035-c14526aaa76a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:39.171165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9983928-751b-4b75-8035-c14526aaa76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.269206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 691/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:39.385522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:39.387067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.419928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.545672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38d1af-a8c4-4bd3-baa9-373bf44f1a56 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:39.566767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde2c7-ff7d-4c9f-bcfc-062183f9cb9e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.567118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde2c7-ff7d-4c9f-bcfc-062183f9cb9e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.567474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde2c7-ff7d-4c9f-bcfc-062183f9cb9e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.568886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 692/1393] 10.222.0.26 () {54 vars in 967 bytes} [Fri Sep 2 05:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:16:39.573750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.574024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.574296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.650022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] MFA Rules not processed for user `d812f7fb4e114ae4ab5d7c2a111df3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:39.651231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.656085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.669166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:39.669784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.670038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.670290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.671901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.687600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.731351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 693/1394] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Sep 2 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:16:39.739075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:39.746300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbeabd-2e6c-4cf0-b1ed-5e8b5d82c29e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:39.766667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:39.768384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f0863-e54d-45de-bbf3-49e9df95c83f service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:39.786671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 702/1395] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:39.825768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:39.826374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:39.826643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:39.826905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:39.828509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:39.955141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:39.959717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:39.961195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ada182-f81e-4eef-aa55-c47dd2847540 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:40.000508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 694/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:16:40.729799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e881-2658-4b07-9525-395a3877c819 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:40.730263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e881-2658-4b07-9525-395a3877c819 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:40.730360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e881-2658-4b07-9525-395a3877c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:40.803419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7dc0e881-2658-4b07-9525-395a3877c819 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:40.804649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7dc0e881-2658-4b07-9525-395a3877c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:40.866783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:40.897761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 703/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:40.940413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:40.940777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:40.941115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:40.942618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 695/1398] 10.222.0.26 () {54 vars in 943 bytes} [Fri Sep 2 05:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:40.948923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea547eb-f4a9-411b-a247-b2861ebdb368 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:40.949224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea547eb-f4a9-411b-a247-b2861ebdb368 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:40.949493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea547eb-f4a9-411b-a247-b2861ebdb368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:41.029853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dea547eb-f4a9-411b-a247-b2861ebdb368 None None] MFA Rules not processed for user `8c7c13d179cf442999070e1e0d1cf89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:41.031052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dea547eb-f4a9-411b-a247-b2861ebdb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:41.143558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 704/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Fri Sep 2 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:41.153293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:41.154801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:41.295168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07286c6-871e-4131-960f-d7c1d1903531 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:41.367832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:41.403666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:41.404275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:41.404548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:41.404810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:41.406430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:41.498066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:41.499724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2f2f-f7ec-45bc-b384-b3890c084cd3 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:41.508210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 696/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:16:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:16:41.719328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:41.719614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:41.719888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:41.721766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 705/1401] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:41.726769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2faa-fb28-4e07-b391-f348ac9a3a60 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:41.727051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2faa-fb28-4e07-b391-f348ac9a3a60 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:41.727354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2faa-fb28-4e07-b391-f348ac9a3a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:41.805457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f3ba2faa-fb28-4e07-b391-f348ac9a3a60 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:41.806600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f3ba2faa-fb28-4e07-b391-f348ac9a3a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:41.868022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:41.913810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 697/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:42.199280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:42.200889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:42.252353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:42.368119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199c4d-6418-492a-9a83-f6a0cf93365f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:42.496420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:42.499161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:42.499983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:42.500433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:42.500893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:42.502638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:42.600867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:42.602778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d461da-f5ff-44fb-9d13-ab66e24c6ef6 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:42.621272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 706/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:44.632149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:44.632722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:44.632722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:44.634326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 698/1404] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:44.640067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8b96-d8a7-4329-82ba-2d1744c00a4f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:44.640488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8b96-d8a7-4329-82ba-2d1744c00a4f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:44.640678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8b96-d8a7-4329-82ba-2d1744c00a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:44.713655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c39d8b96-d8a7-4329-82ba-2d1744c00a4f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:44.715181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c39d8b96-d8a7-4329-82ba-2d1744c00a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:44.795008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:44.829429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 707/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:45.119936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:45.121638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:45.288510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09be2-9498-41fb-9dd5-682828ab947f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:45.331565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:45.413596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:45.414118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:45.414393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:45.414663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:45.416318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:45.521718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:45.523359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735899ca-f51d-46b1-a45b-cd0630f58ef5 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:45.542459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 699/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:47.523905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:47.524484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:47.524484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:47.525851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 708/1407] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:16:47.531250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cad467-2200-4386-a872-ceaf03a080e9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:47.531669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cad467-2200-4386-a872-ceaf03a080e9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:47.531821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cad467-2200-4386-a872-ceaf03a080e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:47.596966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:47.603902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e9cad467-2200-4386-a872-ceaf03a080e9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:16:47.605122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e9cad467-2200-4386-a872-ceaf03a080e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:47.832876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 700/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:16:48.122004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:16:48.123551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:48.277500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad30ba-98bc-4557-bb19-9725857d326e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:16:48.339353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:48.410219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:16:48.410452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:16:48.410686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:16:48.410870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:16:48.412587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:16:48.511525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:16:48.513535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71936dcb-6ce1-4c1a-9470-e01e0cde1b5c service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:16:48.535045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 709/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:16:57.831002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=44 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:16:58.532629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=73 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:03.649655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2fdc2-4a83-46a1-9096-762a7a56d153 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:03.650214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2fdc2-4a83-46a1-9096-762a7a56d153 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:03.650214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2fdc2-4a83-46a1-9096-762a7a56d153 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:03.651569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 701/1410] 10.222.0.26 () {54 vars in 918 bytes} [Fri Sep 2 05:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:03.657722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88e20-2514-405f-a603-33753baf16f2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:03.658172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88e20-2514-405f-a603-33753baf16f2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:03.658287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88e20-2514-405f-a603-33753baf16f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:03.744069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-91c88e20-2514-405f-a603-33753baf16f2 None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:03.745179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-91c88e20-2514-405f-a603-33753baf16f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:03.871694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 710/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Sep 2 05:17:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:03.887163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2ea8-e187-4e30-8faf-f363ed66ad8d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:03.887478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2ea8-e187-4e30-8faf-f363ed66ad8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:03.887748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2ea8-e187-4e30-8faf-f363ed66ad8d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:03.889097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 702/1412] 10.222.0.26 () {54 vars in 918 bytes} [Fri Sep 2 05:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:03.894932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3366-4e50-4f1d-8c25-b739f7e59373 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:03.895226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3366-4e50-4f1d-8c25-b739f7e59373 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:03.895522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3366-4e50-4f1d-8c25-b739f7e59373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:03.978301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:03.982163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7e2c3366-4e50-4f1d-8c25-b739f7e59373 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:03.984863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7e2c3366-4e50-4f1d-8c25-b739f7e59373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:04.122771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 711/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Sep 2 05:17:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:06.467002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:06.467553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:06.467553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:06.469051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:06.474858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc03f0-f9ce-43b6-93e9-34d25956d1be None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:06.475352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc03f0-f9ce-43b6-93e9-34d25956d1be None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:06.475450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc03f0-f9ce-43b6-93e9-34d25956d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:06.545720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f7cc03f0-f9ce-43b6-93e9-34d25956d1be None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:06.546851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f7cc03f0-f9ce-43b6-93e9-34d25956d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:06.605664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:06.651766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:06.957056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:06.958720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:07.122157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f7e12-2395-4517-9667-11be0fd0467a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:07.213164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:07.255880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:07.256470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:07.256744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:07.257006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:07.258597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:07.352986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:07.354593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b4e0a-9778-4725-a2b3-57f4a050dad5 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:07.373438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 704/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:08.286956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:08.287843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:08.287843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:08.289841 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:08.297442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efca6b-059f-4dd6-890d-a910d14e7235 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:08.297922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efca6b-059f-4dd6-890d-a910d14e7235 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:08.298027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efca6b-059f-4dd6-890d-a910d14e7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:08.377954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-90efca6b-059f-4dd6-890d-a910d14e7235 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:08.379336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-90efca6b-059f-4dd6-890d-a910d14e7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:08.406444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:08.479290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:17:08.628433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:08.629859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:08.793026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e48d97-ca74-4250-b134-ce0d4a5680c2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:08.836177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:08.915462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:08.916205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:08.916560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:08.916956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:08.919593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:09.017399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:09.019075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec1f3-e8e9-4fb7-b1a1-70c9a41b4aae service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:09.037775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 714/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:09.916962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:09.917878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:09.917878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:09.920058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:09.926093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cade35a-82bd-4528-bfd1-fb5e74445cd1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:09.926550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cade35a-82bd-4528-bfd1-fb5e74445cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:09.926673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cade35a-82bd-4528-bfd1-fb5e74445cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:09.985495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:10.013481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4cade35a-82bd-4528-bfd1-fb5e74445cd1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:10.014719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4cade35a-82bd-4528-bfd1-fb5e74445cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:10.122556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:10.272883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:10.275349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:10.432127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d890-d41c-4976-8462-3216c14b5095 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:10.444528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:10.557116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:10.557739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:10.558015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:10.558280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:10.559942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:10.678184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:10.679820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73dd1-a2a1-493c-b86c-12078161a709 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:10.699173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 707/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:11.554170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:11.555087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:11.555087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:11.557300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:11.563570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148f15-1fa0-4549-b972-94cefef1957e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:11.564327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148f15-1fa0-4549-b972-94cefef1957e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:11.564621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148f15-1fa0-4549-b972-94cefef1957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:11.586199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:11.645649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d0148f15-1fa0-4549-b972-94cefef1957e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:11.646825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d0148f15-1fa0-4549-b972-94cefef1957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:11.747531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:11.896244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:11.898671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:12.028740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:12.068463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3855-f15d-4c87-aedc-043a8b73d454 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:12.218922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:12.219558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:12.219845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:12.220112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:12.221713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:12.302711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:12.317691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:12.319340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a4d6-4f91-4e90-b17c-69a47da445b1 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:12.339081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 717/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:13.188244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:13.189161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:13.189724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:13.192878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:13.199941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f6fe-683b-44aa-a1ef-76488edf5b6e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:13.200373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f6fe-683b-44aa-a1ef-76488edf5b6e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:13.200477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f6fe-683b-44aa-a1ef-76488edf5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:13.286078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3559f6fe-683b-44aa-a1ef-76488edf5b6e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:13.287877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3559f6fe-683b-44aa-a1ef-76488edf5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:13.399807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:13.551504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:13.552988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:13.657957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:13.725003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac94ee-fe37-4b96-a440-e93682224387 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:13.850644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:13.851763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:13.851763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:13.851763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:13.853383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:13.910704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:13.954147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:13.955766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a0df9-b4d8-4090-9478-8cf3f3fd8a36 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:13.975386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 710/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:14.776166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:14.777022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:14.777022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:14.779140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:14.784241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4b12-7d87-4ba9-a50f-5f9747d61b2d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:14.784754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4b12-7d87-4ba9-a50f-5f9747d61b2d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:14.784863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4b12-7d87-4ba9-a50f-5f9747d61b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:14.865756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f53c4b12-7d87-4ba9-a50f-5f9747d61b2d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:14.866940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f53c4b12-7d87-4ba9-a50f-5f9747d61b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:14.981899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:17:15.131248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:15.132667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:15.184745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:15.282918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02337b-4d2e-4f46-a2b0-189eb0d696df None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:15.404624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:15.405101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:15.405409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:15.405676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:15.407233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:15.414410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:15.505830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:15.507487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027444-2439-4af6-b70a-ae9f9b945ff1 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:15.526070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 720/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:16.341109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:16.341721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:16.341721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:16.343000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:16.348839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d3dd-0e71-465a-9f6c-b2580d285ef7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:16.349596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d3dd-0e71-465a-9f6c-b2580d285ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:16.349720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d3dd-0e71-465a-9f6c-b2580d285ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:16.445981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0cd0d3dd-0e71-465a-9f6c-b2580d285ef7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:16.447576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0cd0d3dd-0e71-465a-9f6c-b2580d285ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:16.521019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:16.550025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:16.704661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:16.706963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:16.725611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:16.871762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27476b-603c-4af4-9a26-487d2643833d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:16.968475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:16.999466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:17.000069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:17.000344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:17.000600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:17.002238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:17.095292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:17.096924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe47ad1-a496-46b9-a38c-0c83849ee7bd service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:17.116122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 713/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:17.946433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:17.947358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:17.947358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:17.949524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:17.957075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb58b-d859-4680-ab43-08346266275c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:17.957542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb58b-d859-4680-ab43-08346266275c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:17.957732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb58b-d859-4680-ab43-08346266275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:18.041997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-99fcb58b-d859-4680-ab43-08346266275c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:18.043212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-99fcb58b-d859-4680-ab43-08346266275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:18.085658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:18.153244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:17:18.306017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:18.307552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:18.470134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c8ec5-c4ff-4d6c-b490-ca9c49a9077b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:18.533596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:18.598056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:18.599638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:18.599898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:18.600434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:18.602096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:18.698987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:18.700633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06255513-7a29-4ada-9731-6d4d631184d4 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:18.719577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 723/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:19.515486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:19.515994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:19.515994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:19.518100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:17:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:19.523449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42867c-0729-4cec-b329-46bf54dceef7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:19.523934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42867c-0729-4cec-b329-46bf54dceef7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:19.524034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42867c-0729-4cec-b329-46bf54dceef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:19.728114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ec42867c-0729-4cec-b329-46bf54dceef7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:19.729209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ec42867c-0729-4cec-b329-46bf54dceef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:19.731386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:19.839750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:19.995735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:19.998083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:20.167338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27ede-bf5e-4a2a-bf9b-ecd38c6af647 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:20.196525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:20.287899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:20.288425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:20.288701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:20.288973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:20.290574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:20.391102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:20.392773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bb1a6-1bfe-4cbc-9c29-a6c4b4994b34 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:20.410511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 716/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:22.199600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:22.200159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:22.200159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:22.201397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:22.207555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acebf-3769-4027-9833-c4ac98e934db None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:22.208003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acebf-3769-4027-9833-c4ac98e934db None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:22.208379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acebf-3769-4027-9833-c4ac98e934db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:22.257455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:22.287438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a25acebf-3769-4027-9833-c4ac98e934db None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:22.301617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a25acebf-3769-4027-9833-c4ac98e934db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:22.414187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:22.706209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:22.707998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:22.816328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65dcf1-606b-47c4-a913-7a0aed0ba01c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:22.848696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:22.890618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:22.891237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:22.891514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:22.891780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:22.893343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:23.017338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:23.018792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073699c-b360-4dd6-a8e7-b23759d96e06 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:23.039030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 726/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:17:25.160904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:25.161469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:25.161469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:25.162831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:25.171930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44705-cdad-4afe-ad99-1ecc94ffebe1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:25.172361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44705-cdad-4afe-ad99-1ecc94ffebe1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:25.172477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44705-cdad-4afe-ad99-1ecc94ffebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:25.248351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-eff44705-cdad-4afe-ad99-1ecc94ffebe1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:25.249575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eff44705-cdad-4afe-ad99-1ecc94ffebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:25.262881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:25.356786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:25.640245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:25.641848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:25.757088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442c21-3bc9-4d61-86f7-d4921531eb7d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:25.769442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:25.834119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:25.834718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:25.834992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:25.835295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:25.836859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:25.963674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:25.965045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f221d-6265-4d13-b7b5-ee5091ead859 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:25.986530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 719/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:28.233233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:28.233813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:28.233813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:28.235148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:28.242131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134308-ddef-4c1a-bab8-ecae9ddcc312 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:28.242821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134308-ddef-4c1a-bab8-ecae9ddcc312 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:28.242954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134308-ddef-4c1a-bab8-ecae9ddcc312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:28.304234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:28.323638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9d134308-ddef-4c1a-bab8-ecae9ddcc312 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:28.324874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9d134308-ddef-4c1a-bab8-ecae9ddcc312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:28.435321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:28.728949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:28.731303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:28.850875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc00f-7b37-440a-8ffc-fc344290fb27 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:28.893644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:28.932541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:28.933156 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:28.933431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:28.933696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:28.935338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:29.068545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:29.069941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e75a-436e-424a-b5b8-d0033f045bb8 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:29.089777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 729/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:31.089154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:31.089753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:31.089753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:31.091023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:31.096440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae170-0dc1-434b-883e-2cdd70b731aa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:31.097238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae170-0dc1-434b-883e-2cdd70b731aa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:31.097851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae170-0dc1-434b-883e-2cdd70b731aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:31.170111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-04cae170-0dc1-434b-883e-2cdd70b731aa None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:31.171383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-04cae170-0dc1-434b-883e-2cdd70b731aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:31.194027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:31.275679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:31.556279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:31.557827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:31.677203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1b58-b04e-49f7-a95a-c85c5db8502e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:31.701355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:31.768870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:31.769370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:31.769794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:31.770101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:31.771671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:31.886922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:31.888417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca45f6e-fbd8-42c5-a8b9-b2aaf266044e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:31.906969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 722/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:34.029741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:34.030632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:34.030632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:34.032902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:34.039555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856aea-1b0f-40b2-8db4-c5142813f475 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:34.040192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856aea-1b0f-40b2-8db4-c5142813f475 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:34.040304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856aea-1b0f-40b2-8db4-c5142813f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:34.120652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:34.124123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fa856aea-1b0f-40b2-8db4-c5142813f475 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:34.126245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fa856aea-1b0f-40b2-8db4-c5142813f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:34.230788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:34.523629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:34.525247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:34.640632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6aa0-199c-4c7e-879c-580a5c71e478 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:34.694785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:34.720514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:34.721049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:34.721328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:34.721596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:34.723546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:34.847678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:34.849121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9be5d2-722c-4f8c-a841-5aa8ea3f7713 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:34.869238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 732/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:36.831614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:36.832229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:36.832229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:36.833569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:36.840034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf30e6-6e02-4f4d-8e93-d379f98962fe None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:36.840725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf30e6-6e02-4f4d-8e93-d379f98962fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:36.840868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf30e6-6e02-4f4d-8e93-d379f98962fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:36.916607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8baf30e6-6e02-4f4d-8e93-d379f98962fe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:36.917817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8baf30e6-6e02-4f4d-8e93-d379f98962fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:36.950349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:37.025061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:37.311178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:37.312755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:37.421254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468170d-b5c9-4709-a101-2981e79fd616 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:37.450280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:37.502549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:37.503156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:37.503492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:37.503755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:37.505347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:37.629346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:37.630717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad16ef-85ef-4871-8d21-4457c68f8822 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:37.650242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 725/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:17:39.603947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:39.604846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:39.604846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:39.606824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:39.615616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8107-d481-4041-af0c-b497691ecb2e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:39.616043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8107-d481-4041-af0c-b497691ecb2e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:39.616158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8107-d481-4041-af0c-b497691ecb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:39.697699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cd8a8107-d481-4041-af0c-b497691ecb2e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:39.699696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd8a8107-d481-4041-af0c-b497691ecb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:39.710366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:39.806640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:40.104583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:40.107166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:40.224118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39674d-563c-440a-9d8c-508fee6e5328 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:40.281718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:40.301057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:40.301659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:40.301933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:40.302197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:40.303811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:40.415059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:40.416581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaed23c-2d49-440c-b3c7-2713ad85a753 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:40.435455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 735/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:42.405776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:42.406386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:42.406386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:42.407716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:42.414417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3ead-1797-4479-a25b-9f90c15890ba None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:42.414872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3ead-1797-4479-a25b-9f90c15890ba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:42.415370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3ead-1797-4479-a25b-9f90c15890ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:42.492002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2c6d3ead-1797-4479-a25b-9f90c15890ba None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:42.493211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2c6d3ead-1797-4479-a25b-9f90c15890ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:42.534233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:42.604560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:42.905209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:42.906771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:43.021373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e3f2-7e63-42ce-b0c1-72c765baaf8c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:43.059666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:43.096403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:43.096998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:43.097269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:43.097535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:43.099158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:43.212909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:43.214287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78942f9f-e5c9-4dbd-bf26-efd68015208e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:43.234322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 728/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:17:45.125448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:45.126246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:45.126246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:45.128869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:45.134345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb649-f7bd-4116-b882-f75802be4f24 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:45.134796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb649-f7bd-4116-b882-f75802be4f24 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:45.134901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb649-f7bd-4116-b882-f75802be4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:45.202842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-817cb649-f7bd-4116-b882-f75802be4f24 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:45.204066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-817cb649-f7bd-4116-b882-f75802be4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:45.222619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:45.305968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:45.598175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:45.600543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:45.715886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7b48-55b5-4a89-88a5-c7cfe807d938 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:45.789523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:45.798645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:45.799684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:45.799991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:45.800240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:45.802309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:45.916700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:45.918137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208410da-98c7-4300-bf94-cc220c4d4808 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:45.937385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 738/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:17:47.874880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:47.875497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:47.875497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:47.877027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:17:47.884829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6e0a3-95a6-4d46-b06b-752efd1cddc1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:47.885309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6e0a3-95a6-4d46-b06b-752efd1cddc1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:47.885414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6e0a3-95a6-4d46-b06b-752efd1cddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:47.955468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a2a6e0a3-95a6-4d46-b06b-752efd1cddc1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:17:47.956672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a2a6e0a3-95a6-4d46-b06b-752efd1cddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:48.008940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:48.060795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:17:48.346641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:17:48.348269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:48.463960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabd1a-8528-4def-97fd-c724f92b89f4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:17:48.516919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:48.543880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:17:48.544483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:17:48.544751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:17:48.545012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:17:48.546583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:17:48.658404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:17:48.659882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd57a0c-c465-41da-a4f6-7760dbf90991 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:17:48.678327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 731/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:17:58.058818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=22 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:17:58.675984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=66 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:08.172856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509eda-1636-48ab-937b-282bc378e049 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:08.173456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509eda-1636-48ab-937b-282bc378e049 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:08.173456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509eda-1636-48ab-937b-282bc378e049 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:08.174678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 740/1471] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:08.180991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804087-b48c-455c-998c-2b4cb191b98a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:08.181435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804087-b48c-455c-998c-2b4cb191b98a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:08.181553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804087-b48c-455c-998c-2b4cb191b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:08.261064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-92804087-b48c-455c-998c-2b4cb191b98a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:08.262275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-92804087-b48c-455c-998c-2b4cb191b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:08.370204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 732/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:08.674050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:08.674328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:08.674603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:08.676018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 741/1473] 10.222.0.26 () {54 vars in 967 bytes} [Fri Sep 2 05:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:08.683828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3d61-db8b-43a3-a185-60709d32164d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:08.684206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3d61-db8b-43a3-a185-60709d32164d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:08.684563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3d61-db8b-43a3-a185-60709d32164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:08.765282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-66cd3d61-db8b-43a3-a185-60709d32164d None None] MFA Rules not processed for user `d812f7fb4e114ae4ab5d7c2a111df3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:08.766407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-66cd3d61-db8b-43a3-a185-60709d32164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:08.787901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:08.856045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 733/1474] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Sep 2 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:08.865094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:08.866972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:08.979518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635dc57-4ab2-404e-8a0f-04673159160d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:09.065381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:09.065907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:09.066306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:09.066583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:09.068352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:09.127709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:09.190228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:09.191746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6017-ef72-4981-a803-11ab29cee2d1 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:09.210950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 742/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:11.192597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:11.193301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:11.193301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:11.194526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 734/1476] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:11.201070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fb69-429a-4720-8796-32d7466a7f19 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:11.201839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fb69-429a-4720-8796-32d7466a7f19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:11.202019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fb69-429a-4720-8796-32d7466a7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:11.279282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a885fb69-429a-4720-8796-32d7466a7f19 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:11.280700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a885fb69-429a-4720-8796-32d7466a7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:11.383881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 743/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:11.650663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:11.653283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:11.800190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6a42-007b-47e4-9618-41a056a25e25 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:11.853057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:11.902048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:11.902666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:11.902938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:11.903230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:11.903864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:11.905607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:18:11.905607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:18:11.905607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:18:11.906764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb176b84-6b4d-4e26-adac-5047e681d8b7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:11.925755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 735/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Sep 2 05:18:11 2022] GET /identity/v3/projects => generated 2553 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:18:13.836799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:13.837407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:13.837407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:13.838682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 744/1479] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:13.845049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254400-b0a1-44c3-b994-55f797c503bf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:13.845817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254400-b0a1-44c3-b994-55f797c503bf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:13.845970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254400-b0a1-44c3-b994-55f797c503bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:13.918007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-91254400-b0a1-44c3-b994-55f797c503bf None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:13.919228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-91254400-b0a1-44c3-b994-55f797c503bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:14.032178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 736/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:14.328062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:14.329743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:14.344329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:14.504774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ca58-b6ee-4519-920d-dda6a6a55505 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:14.609687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:14.645260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:14.646010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:14.646283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:14.646546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:14.648186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:14.756290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:14.757896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b439ff3-e35a-42c4-b6d4-e2aa99bbf10a service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:14.776639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 745/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:16.919438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:16.920326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:16.920326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:16.922422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 737/1482] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:16.930441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6003-4a25-4a93-92b2-f83eb00f6230 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:16.930905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6003-4a25-4a93-92b2-f83eb00f6230 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:16.931008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6003-4a25-4a93-92b2-f83eb00f6230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:17.002746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a33a6003-4a25-4a93-92b2-f83eb00f6230 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:17.004025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a33a6003-4a25-4a93-92b2-f83eb00f6230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:17.055705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:17.108255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 746/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:18:17.408268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:17.410692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:17.441517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:17.528114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2152b5-d1ab-4031-b2ce-7f80c8eb2103 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:17.609783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:17.610390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:17.610672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:17.610935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:17.612584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:17.689811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:17.739356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:17.741137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69d02-a3cb-40b9-aa87-a7e86dee39a0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:17.761160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 738/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:19.689478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:19.690007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:19.690007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:19.691269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 747/1485] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:19.700024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56119-6a77-4dec-8e21-82e7ce60b07f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:19.700721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56119-6a77-4dec-8e21-82e7ce60b07f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:19.700894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56119-6a77-4dec-8e21-82e7ce60b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:19.777000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-02c56119-6a77-4dec-8e21-82e7ce60b07f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:19.778201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02c56119-6a77-4dec-8e21-82e7ce60b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:19.888586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 739/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:20.179258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:20.180907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:20.297098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06150d4-1967-4c6b-afd9-e15d253389e4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:20.377123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:20.378976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:20.379645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:20.379973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:20.380252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:20.382695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:20.514009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:20.515493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bec65-e21e-4ff6-b399-08b3ea2cdcda service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:20.533678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 748/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:22.538776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:22.539738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:22.539738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:22.541836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 740/1488] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:22.550660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffe95-7a90-43b4-adf9-cfb42c370f66 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:22.551155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffe95-7a90-43b4-adf9-cfb42c370f66 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:22.551344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffe95-7a90-43b4-adf9-cfb42c370f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:22.621132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a05ffe95-7a90-43b4-adf9-cfb42c370f66 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:22.622362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a05ffe95-7a90-43b4-adf9-cfb42c370f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:22.677990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:22.722676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 749/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:23.017381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:23.018931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:23.056953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:23.126343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9229cd8-a1ee-408b-87a9-1fa55fad2caf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:23.207060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:23.207902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:23.208346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:23.208624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:23.210227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:23.314616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:23.345322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:23.346797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5757f-9a66-4576-9281-f29e30775f14 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:23.366279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 741/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:25.489313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:25.489872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:25.489872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:25.491570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 750/1491] 10.222.0.26 () {54 vars in 927 bytes} [Fri Sep 2 05:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:18:25.496968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31040-3925-4b85-8671-fa58b89697fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:25.497397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31040-3925-4b85-8671-fa58b89697fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:25.497505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31040-3925-4b85-8671-fa58b89697fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:25.569049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ebd31040-3925-4b85-8671-fa58b89697fe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:18:25.570263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ebd31040-3925-4b85-8671-fa58b89697fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:25.676005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 742/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Sep 2 05:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:18:25.971342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:18:25.973777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:26.092213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a36f4a-ac8f-4796-96d0-e9844d6c0997 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:18:26.172923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:18:26.173443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:18:26.173720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:18:26.173981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:18:26.175595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:18:26.185018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:26.295178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:18:26.296653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0da8-39e0-4821-adb9-5e4a06655277 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:18:26.314876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 751/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:18:35.673838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:18:36.312672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=50 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:39.226850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:39.227863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:39.227863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:39.317007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:19:39.318447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:39.426848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 743/1494] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:19:39.439167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929622-224d-4eba-990a-4876c914302e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:39.439709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929622-224d-4eba-990a-4876c914302e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:39.439709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929622-224d-4eba-990a-4876c914302e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:39.520667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-35929622-224d-4eba-990a-4876c914302e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:19:39.521741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-35929622-224d-4eba-990a-4876c914302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:39.623925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 752/1495] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:19:39.631273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:39.633109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:39.648921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793c38e-f373-467a-880e-dc81a7633d45 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:39.712304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:39.748771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:39.749379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:39.749646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:39.749905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:39.750541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:19:39.750826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:39.751877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:39.751877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:19:39.751877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:19:39.752789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:39.765686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 744/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:19:39.774625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929622-224d-4eba-990a-4876c914302e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:39.784205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929622-224d-4eba-990a-4876c914302e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:39.850461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:39.890978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:39.891674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:39.891953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:39.892193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:39.892843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:39.894637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:39.894637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:19:39.894637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:19:39.895930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:39.957790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 753/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:19:39 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:19:39.962530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:39.964099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:40.000306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d7b4-c4a5-4c5e-8396-ac72c188c964 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:40.117099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:40.118196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.118471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.118780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.119744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:40.121360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:40.121360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:19:40.121360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:19:40.123187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:40.176233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 745/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:19:39 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:19:40.182221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:40.183756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:40.248133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e7e5-5618-4b30-bf3b-18a7445ddc72 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:40.336208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:40.347754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:40.348363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.348637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.348904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.349547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:40.350611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:40.350611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:19:40.350611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:19:40.351534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:40.370079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 754/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:19:40.374258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:40.375767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:40.389619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd5696-3643-4f2f-be23-3d5267d11a65 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:40.416708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:40.493268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:40.493879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.494146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.494404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.495040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:40.496097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:40.496097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:19:40.496097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:19:40.496979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141d28e-2d13-4b2d-8630-413029ac1c1d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:40.510003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 746/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:19:40.514381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:40.515955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:40.551831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6861-86da-4b8f-92d7-0b3cd2afa71d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:40.667316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:40.667928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.668201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.668467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] PATH_INFO: `/v3/projects/d9c875e53e234d71bf91df6feeed5b05/users/d98a69dd2fe94799bb600cee6d3cb713/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.692487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c875e53e234d71bf91df6feeed5b05, user_id=d98a69dd2fe94799bb600cee6d3cb713, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:40.693768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:40.693768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:19:40.693768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:19:40.695764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530ef45-60bb-4012-9e03-8e128ecab1bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:40.724124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 755/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:19:40 2022] PUT /identity/v3/projects/d9c875e53e234d71bf91df6feeed5b05/users/d98a69dd2fe94799bb600cee6d3cb713/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:19:40.736424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4f00-433c-4fa3-9334-12d52fb166fa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.736717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4f00-433c-4fa3-9334-12d52fb166fa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.737150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4f00-433c-4fa3-9334-12d52fb166fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.803184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-785c4f00-433c-4fa3-9334-12d52fb166fa None None] MFA Rules not processed for user `d98a69dd2fe94799bb600cee6d3cb713`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:19:40.804642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-785c4f00-433c-4fa3-9334-12d52fb166fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:40.887311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 747/1502] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:19:40.901099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.901391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.901667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.903036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 756/1503] 10.222.0.26 () {54 vars in 964 bytes} [Fri Sep 2 05:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:19:40.908086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ba43-2cb5-4a7a-873a-8e0907f186fa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:40.908372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ba43-2cb5-4a7a-873a-8e0907f186fa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:40.908648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ba43-2cb5-4a7a-873a-8e0907f186fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:40.941166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:40.994560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1723ba43-2cb5-4a7a-873a-8e0907f186fa None None] MFA Rules not processed for user `c891710c74ca4a4dae183c7979152109`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:19:40.995798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1723ba43-2cb5-4a7a-873a-8e0907f186fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:41.077146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 748/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Sep 2 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:19:41.087040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:41.088596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:41.141657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:41.201699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7378-cdf0-4ef3-82cf-b78b3124b332 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:41.285461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:41.286051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:41.286332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:41.286597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:41.288731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:41.399796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:41.401232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:41.404795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:41.427395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 757/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:19:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:19:41.475737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d22b3-fda6-484e-85bd-38970be332c4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:41.476202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d22b3-fda6-484e-85bd-38970be332c4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:41.476309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d22b3-fda6-484e-85bd-38970be332c4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:41.477560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 749/1506] 10.222.0.26 () {52 vars in 830 bytes} [Fri Sep 2 05:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:19:41.481375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:41.482629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:41.604919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11042ed5-fc71-488b-9450-1be412310469 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:41.707050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:41.707630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:41.707909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:41.708180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] PATH_INFO: `/v3/users/d98a69dd2fe94799bb600cee6d3cb713` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:41.720693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98a69dd2fe94799bb600cee6d3cb713)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:41.721737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:41.721737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:19:41.721737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:19:41.722997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:41.733560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:41.794518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98a69dd2fe94799bb600cee6d3cb713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:41.806174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98a69dd2fe94799bb600cee6d3cb713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:41.820477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98a69dd2fe94799bb600cee6d3cb713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:41.820917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98a69dd2fe94799bb600cee6d3cb713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:41.845682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98a69dd2fe94799bb600cee6d3cb713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:41.853667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 758/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:19:41 2022] DELETE /identity/v3/users/d98a69dd2fe94799bb600cee6d3cb713 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:19:41.860394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef34f-529c-424f-adba-486edab16daa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:41.860843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef34f-529c-424f-adba-486edab16daa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:41.861164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef34f-529c-424f-adba-486edab16daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:41.925573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f0bef34f-529c-424f-adba-486edab16daa None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:19:41.926765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f0bef34f-529c-424f-adba-486edab16daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:42.017631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:42.031487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 750/1508] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:19:42.045333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:42.046549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:42.155035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae956-eafb-4861-bc27-417a3dd0b1a7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:42.216744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:42.236755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:42.237373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:42.237649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:42.237916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:42.239521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:42.371439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:42.373401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9a0a-b8af-4e02-9850-fad8d6f8009f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:42.395550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 759/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:19:42.747083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bef34f-529c-424f-adba-486edab16daa None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:19:42.748417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f0bef34f-529c-424f-adba-486edab16daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:19:42.760415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bef34f-529c-424f-adba-486edab16daa None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:19:42.859489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:19:42.860119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:19:42.860392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:19:42.860659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] PATH_INFO: `/v3/projects/d9c875e53e234d71bf91df6feeed5b05` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:19:42.872849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c875e53e234d71bf91df6feeed5b05)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:19:42.873955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:19:42.873955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:19:42.873955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:19:42.875097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:19:42.936841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c875e53e234d71bf91df6feeed5b05', 'request_id': 'req-976c5901-2e95-44db-a962-e569cefabd4d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:42.950005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c875e53e234d71bf91df6feeed5b05', 'request_id': 'req-976c5901-2e95-44db-a962-e569cefabd4d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:42.956080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c875e53e234d71bf91df6feeed5b05', 'request_id': 'req-976c5901-2e95-44db-a962-e569cefabd4d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:42.990776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] The token cache is being invalidate because project d9c875e53e234d71bf91df6feeed5b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:19:42.991107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:42.991591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-976c5901-2e95-44db-a962-e569cefabd4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:19:42.994779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 751/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:19:42 2022] DELETE /identity/v3/projects/d9c875e53e234d71bf91df6feeed5b05 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:19:52.393117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=62 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:19:52.988225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:15.378727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:15.379443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:15.379443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:15.380770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:15.386758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf3c3-42b8-4c4f-921f-e85915c68bae None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:15.387181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf3c3-42b8-4c4f-921f-e85915c68bae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:15.387301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf3c3-42b8-4c4f-921f-e85915c68bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:15.482332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ffdcf3c3-42b8-4c4f-921f-e85915c68bae None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:15.483580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ffdcf3c3-42b8-4c4f-921f-e85915c68bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:15.610260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:15.768741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:15.772903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:15.914039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e0645-bdab-4c5d-aaa7-7c46f12569d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:15.920174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:15.920800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:15.921076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:15.921363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:15.929852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:15.931500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3ee2-8528-40e4-b016-335233f67d69 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:15.940965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 761/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:16.773854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb88-3332-4931-8787-061bead31e80 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:16.774372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb88-3332-4931-8787-061bead31e80 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:16.774372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb88-3332-4931-8787-061bead31e80 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:16.775843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:16.780917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca738-a5a1-4582-89f4-5ec366438dcc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:16.781387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca738-a5a1-4582-89f4-5ec366438dcc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:16.781494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca738-a5a1-4582-89f4-5ec366438dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:16.814229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a7eca738-a5a1-4582-89f4-5ec366438dcc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:16.815398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a7eca738-a5a1-4582-89f4-5ec366438dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:16.828764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:21:16.992965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cb88-3332-4931-8787-061bead31e80 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:17.015059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cb88-3332-4931-8787-061bead31e80 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:17.020859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:17.021488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:17.021788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:17.022019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:17.030720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:17.032379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f1737-6fd1-40f5-996a-8f5788c0247e service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:17.042827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 754/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:17.426595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04899-de70-492a-8197-da06694aa1f6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:17.426830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04899-de70-492a-8197-da06694aa1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:17.427032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04899-de70-492a-8197-da06694aa1f6 None None] PATH_INFO: `/v3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:17.428436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 763/1517] 10.222.0.36 () {54 vars in 925 bytes} [Fri Sep 2 05:21:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:21:17.435387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14b1f-3de5-4fc5-a6ef-2f2bb0d1e86b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:17.435657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14b1f-3de5-4fc5-a6ef-2f2bb0d1e86b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:17.435930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14b1f-3de5-4fc5-a6ef-2f2bb0d1e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:17.501125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-49b14b1f-3de5-4fc5-a6ef-2f2bb0d1e86b None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:17.502350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49b14b1f-3de5-4fc5-a6ef-2f2bb0d1e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:17.520485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:17.582628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 755/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Sep 2 05:21:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:21:21.404655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e76f-ff6b-42d9-a07c-881bb06fe4d1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:21.405187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e76f-ff6b-42d9-a07c-881bb06fe4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:21.405187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e76f-ff6b-42d9-a07c-881bb06fe4d1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:21.406506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 764/1519] 10.222.0.26 () {54 vars in 961 bytes} [Fri Sep 2 05:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:21.414360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c1c8-17f1-46ee-acd8-81798243c08c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:21.414819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c1c8-17f1-46ee-acd8-81798243c08c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:21.414921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c1c8-17f1-46ee-acd8-81798243c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:21.436782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8a29c1c8-17f1-46ee-acd8-81798243c08c None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:21.437986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a29c1c8-17f1-46ee-acd8-81798243c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:21.448430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 756/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Sep 2 05:21:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:21.456037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e76f-ff6b-42d9-a07c-881bb06fe4d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:21.471050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e76f-ff6b-42d9-a07c-881bb06fe4d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:21.477936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:21.478544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:21.478822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:21.479093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:21.487551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:21.489149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62411020-2771-4529-a8b4-2ad1288cd8b8 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:21.499212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 765/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:28.283971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193e4b-0977-4e21-99dc-acdd29ad0b9d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:28.284569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193e4b-0977-4e21-99dc-acdd29ad0b9d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:28.284569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193e4b-0977-4e21-99dc-acdd29ad0b9d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:28.285767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:28.291011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0dee-ddbc-4e4a-a52a-68ab593d541e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:28.291512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0dee-ddbc-4e4a-a52a-68ab593d541e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:28.291618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0dee-ddbc-4e4a-a52a-68ab593d541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:28.319072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-42eb0dee-ddbc-4e4a-a52a-68ab593d541e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:28.320306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-42eb0dee-ddbc-4e4a-a52a-68ab593d541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:28.329726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:28.487714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193e4b-0977-4e21-99dc-acdd29ad0b9d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:28.504142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193e4b-0977-4e21-99dc-acdd29ad0b9d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:28.510725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:28.511366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:28.511640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:28.511906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:28.520057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:28.521686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e533f-dc50-4338-82a7-3368d5b4099e service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:28.530972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 758/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:29.350775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d664b-9e7a-46a0-8b32-11b67bddb96c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:29.351725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d664b-9e7a-46a0-8b32-11b67bddb96c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:29.351725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d664b-9e7a-46a0-8b32-11b67bddb96c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:29.353896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 05:21:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:29.359698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334149b-37d9-4320-bb04-6364c3fea4be None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:29.360147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334149b-37d9-4320-bb04-6364c3fea4be None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:29.360263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334149b-37d9-4320-bb04-6364c3fea4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:29.383144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0334149b-37d9-4320-bb04-6364c3fea4be None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:29.384370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0334149b-37d9-4320-bb04-6364c3fea4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:29.393490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 05:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:29.546749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d664b-9e7a-46a0-8b32-11b67bddb96c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:29.565108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d664b-9e7a-46a0-8b32-11b67bddb96c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:29.571832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:29.572438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:29.572717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:29.572997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:29.581544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:29.583137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25ede0-6caa-4a4d-83d2-18a79279220e service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:29.593025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 768/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:33.319700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:33.320302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:33.320302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:33.321657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:33.327956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e873-09a8-4dc9-9aaf-3f45e6f40fbd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:33.328681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e873-09a8-4dc9-9aaf-3f45e6f40fbd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:33.328968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e873-09a8-4dc9-9aaf-3f45e6f40fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:33.356804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5628e873-09a8-4dc9-9aaf-3f45e6f40fbd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:33.358027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5628e873-09a8-4dc9-9aaf-3f45e6f40fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:33.369446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:33.664669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:33.666515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:33.753805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957193-26a7-49ad-8086-d4cb01cc5544 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:33.757860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:33.758463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:33.758737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:33.759000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:33.768647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:33.770102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88673-2944-4b26-93d7-ae0b2b76f8ee service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:33.779732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 761/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:21:35.714534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e14f-b07a-4c83-a23a-1a54fccf3a02 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:35.715143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e14f-b07a-4c83-a23a-1a54fccf3a02 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:35.715143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e14f-b07a-4c83-a23a-1a54fccf3a02 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:35.716451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:35.723118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fff8-fa7c-49c3-9aaa-02768bfab6ab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:35.723945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fff8-fa7c-49c3-9aaa-02768bfab6ab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:35.723945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fff8-fa7c-49c3-9aaa-02768bfab6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:35.746706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8693fff8-fa7c-49c3-9aaa-02768bfab6ab None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:35.747948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8693fff8-fa7c-49c3-9aaa-02768bfab6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:35.757771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:36.043342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3e14f-b07a-4c83-a23a-1a54fccf3a02 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:36.056616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3e14f-b07a-4c83-a23a-1a54fccf3a02 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:36.061331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:36.061935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:36.062213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:36.062487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:36.073230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:36.074658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5141d-007e-41b1-a471-542d866f6621 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:36.085084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 771/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:39.547932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:39.548540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:39.548540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:39.549850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:39.556117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2361e-4dcb-4745-b17b-da44f88a1084 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:39.556671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2361e-4dcb-4745-b17b-da44f88a1084 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:39.556671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2361e-4dcb-4745-b17b-da44f88a1084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:39.581260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-51d2361e-4dcb-4745-b17b-da44f88a1084 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:39.582803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-51d2361e-4dcb-4745-b17b-da44f88a1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:39.597425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:40.229966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:40.232352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:40.330383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:40.347519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686a075-3fc5-4351-8169-e68abb057799 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:40.353425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:40.354298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:40.354677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:40.355038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:40.371467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:40.373089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b38d6-b57c-412e-a67c-77921bc972bd service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:40.386988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 764/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:42.319719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:42.320310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:42.320310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:42.321551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 05:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:21:42.327960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d618-2740-47f9-9adf-80aa16ee2956 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:42.328653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d618-2740-47f9-9adf-80aa16ee2956 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:42.328927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90d618-2740-47f9-9adf-80aa16ee2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:42.357618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6e90d618-2740-47f9-9adf-80aa16ee2956 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:21:42.358834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6e90d618-2740-47f9-9adf-80aa16ee2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:42.367809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 05:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:21:42.922002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:21:42.924111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:21:42.934421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:42.941072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfa5ec-3481-4331-84cc-ee3c10deb6d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:21:42.944980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:21:42.945583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:21:42.945835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:21:42.946107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:21:42.955329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:21:42.956769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ec23-f1d9-428a-9b03-2544b1538a93 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:21:42.966426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 774/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:21:52.352726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=11 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:21:52.962505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:10.265510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.266165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.266165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.296607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.298006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.313902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 766/1540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:10.323428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.324461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.324930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.360647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.362336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.377992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 775/1541] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.382840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.399161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dc656-6c09-44c3-9fdf-8bbdfc20763a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.410447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.411104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.411404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.411672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.412340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:10.412639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.414278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc130d-c237-48f5-b910-bffc67682cd2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.429602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 767/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:10.438555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.452753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c89c7-a705-491c-8514-7845218fe9ba None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.462925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.463916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.464399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.464843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.465682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.467981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.530941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c465a8-a3d2-4dfe-bd54-4f8a79494e87 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.531337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c465a8-a3d2-4dfe-bd54-4f8a79494e87 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.531519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c465a8-a3d2-4dfe-bd54-4f8a79494e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.532445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 776/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:10.537035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.569467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-60c465a8-a3d2-4dfe-bd54-4f8a79494e87 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.570694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-60c465a8-a3d2-4dfe-bd54-4f8a79494e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.667717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8d5c6-f4a3-40d8-9088-7dba3efcd468 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.679234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.680487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.680987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.681467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.683048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.684348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:10.684348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:23:10.684348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:23:10.686018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce9862-adf9-43b0-b257-b91208828bf8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.705664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 768/1544] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.709247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968747d1-9081-4687-809b-35d2dd26efe6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.710579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968747d1-9081-4687-809b-35d2dd26efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.711078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968747d1-9081-4687-809b-35d2dd26efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.730555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 777/1545] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:23:10.732380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4a5d-740e-4011-a3cc-b342d4b34646 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.732730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4a5d-740e-4011-a3cc-b342d4b34646 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.733068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4a5d-740e-4011-a3cc-b342d4b34646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.736884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-968747d1-9081-4687-809b-35d2dd26efe6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.738101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-968747d1-9081-4687-809b-35d2dd26efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.748660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 769/1546] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.750040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd02e-6b86-49e0-903f-6e2b7c07327e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.750324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd02e-6b86-49e0-903f-6e2b7c07327e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.750593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd02e-6b86-49e0-903f-6e2b7c07327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.756654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-541d4a5d-740e-4011-a3cc-b342d4b34646 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.758021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-541d4a5d-740e-4011-a3cc-b342d4b34646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.768276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 778/1547] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.769743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386bbee-be8d-4fd3-94e9-4434ecc3a2bc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.769878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386bbee-be8d-4fd3-94e9-4434ecc3a2bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.770160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386bbee-be8d-4fd3-94e9-4434ecc3a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.771365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-450bd02e-6b86-49e0-903f-6e2b7c07327e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.772564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-450bd02e-6b86-49e0-903f-6e2b7c07327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.781376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 770/1548] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.782669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.782952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.783243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.796446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d386bbee-be8d-4fd3-94e9-4434ecc3a2bc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.797746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d386bbee-be8d-4fd3-94e9-4434ecc3a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.804709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.805880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.810185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 779/1549] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.811500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e855d-224b-4528-b141-b158cf4b6cf7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.811778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e855d-224b-4528-b141-b158cf4b6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.812053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e855d-224b-4528-b141-b158cf4b6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.814700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 771/1550] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.815550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.826572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a88d7c-46f3-4d92-ab0b-897b747d6e2c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.831990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.832937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.833212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.833492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.834121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.834683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8f2e855d-224b-4528-b141-b158cf4b6cf7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.835909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8f2e855d-224b-4528-b141-b158cf4b6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.836103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590a917-34e7-43dd-b705-d9ee35419a8b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.844698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 780/1551] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.845781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98493e4-14dd-47c7-8c35-3915cd2a5312 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.846063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98493e4-14dd-47c7-8c35-3915cd2a5312 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.846328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98493e4-14dd-47c7-8c35-3915cd2a5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.847322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 772/1552] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:10.848612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038811a-1ba7-41fe-894b-a5aa6ce15224 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.848898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038811a-1ba7-41fe-894b-a5aa6ce15224 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.849166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038811a-1ba7-41fe-894b-a5aa6ce15224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.868520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6038811a-1ba7-41fe-894b-a5aa6ce15224 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.868734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e98493e4-14dd-47c7-8c35-3915cd2a5312 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.870039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6038811a-1ba7-41fe-894b-a5aa6ce15224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.870173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e98493e4-14dd-47c7-8c35-3915cd2a5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.878274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 781/1554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.878405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 773/1554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.879301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.879428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31ef9-0e65-4e25-bc48-2d681ef40730 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.879582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.879697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31ef9-0e65-4e25-bc48-2d681ef40730 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.879844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31ef9-0e65-4e25-bc48-2d681ef40730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.879971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.899423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.899647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aae31ef9-0e65-4e25-bc48-2d681ef40730 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.900605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.900792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aae31ef9-0e65-4e25-bc48-2d681ef40730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.908547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 782/1555] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.909092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 774/1556] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.910160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.910446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.910720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.912920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.930590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.931761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.932791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854eaa5-be59-460d-bf22-83d0554156b2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.938453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.939073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.939379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.939645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.940054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 775/1557] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.940296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:10.940594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.940942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.941593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:10.941593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:23:10.941593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:23:10.942479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1be0-6e64-44cc-8d99-15911fe61b5a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.952948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94870-7a5f-4886-a0ac-88c6bd40b36e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.955159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 783/1558] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:10.956354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.956638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.956911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.961681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.962301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.962577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.962844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.963527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.965130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.975760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 776/1559] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:10.976593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.976933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:10.978356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:10.986419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a32b8-c952-4ca0-8bcc-59662844383e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:10.986599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 784/1560] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:10.987393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:10.991636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:10.992224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:10.992501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:10.992769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:10.993389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:10.993682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:10.995626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:10.996952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70196ca-ea4e-4ac8-b1ad-4ca4c45f662d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.001632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.002220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.002493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.002759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.003409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:11.003720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.005320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76c3f-ff96-44e4-a973-19380a0552d6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.009454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 777/1561] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.010406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.017875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 785/1562] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.019097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c08-466e-4104-86db-2038cd198bfd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.019414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c08-466e-4104-86db-2038cd198bfd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.019726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c08-466e-4104-86db-2038cd198bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.031138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb582dd-65cf-491d-a9b6-b9aaba88eb37 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.036892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.037619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.037868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.038143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.038782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:11.039081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.040779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.042479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-48176c08-466e-4104-86db-2038cd198bfd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:11.043764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48176c08-466e-4104-86db-2038cd198bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:11.053102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 778/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.053258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 786/1564] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:11.053903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176c08-466e-4104-86db-2038cd198bfd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.057312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.065400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176c08-466e-4104-86db-2038cd198bfd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.069381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b52c-fe62-47ad-bdd3-d647356330dd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.070315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.070930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.071228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.071509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.072143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.074049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.074464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.075189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.075443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.075717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.076471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:11.076773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.078359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.091290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 779/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.092355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.102738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6483-3927-4ee9-be0c-d03e434dbdc1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.108124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.108843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.109129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.109413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] PATH_INFO: `/v3/projects/26591bb546ce494099c8f896afd0833b/users/ad165b2ffe474917b042bfa5d356366b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.109561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 787/1566] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.110375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.127447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] RBAC: Authorizing `identity:create_grant(project_id=26591bb546ce494099c8f896afd0833b, user_id=ad165b2ffe474917b042bfa5d356366b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.128494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:11.128494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:23:11.128494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:23:11.129765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.130446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.144343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 780/1567] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:11 2022] PUT /identity/v3/projects/26591bb546ce494099c8f896afd0833b/users/ad165b2ffe474917b042bfa5d356366b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:11.145136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.162723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.176499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c436-34c4-403c-8266-b6cc1e1e5978 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.208620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde3805-79e7-4dea-8650-3dc6f09facad admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.213255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.213863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.214132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.214396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.215056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.216188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:11.216188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:23:11.216188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:23:11.217412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.234620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.235266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.235552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.235815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.236496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:11.236786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.238391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.246167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 781/1568] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.246973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.262367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 788/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.263491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.275400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553a7c2-ee73-4a91-ad87-ccefb2cc40ec admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.310439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf562c9-3f3a-4374-9156-7b43dee05893 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.315700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.316409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.316689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.316957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.317585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.319623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.332559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.333173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.333451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.333723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.334368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:11.334670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.336359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.347724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 782/1570] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.348700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.356569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 789/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:11.356569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.362452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6375a-cda5-4c17-92d1-0fbd6ea02c37 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.409507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.416806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5f524-3dea-4af2-b575-c9e19b1e6f5e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.418396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.419096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.419402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.419673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.420303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.422101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.422247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.422843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.423147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.423459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.424114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.426067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdcc2d-9cc5-46ad-a83f-1412f45c02b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.451863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 790/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.455526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 783/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.455526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.455526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.455526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.456089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.475427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:11.476630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:11.481713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.519516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2680-6de1-4878-8083-7e78edd03180 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.536736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 784/1574] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:11.537545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.547011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a093fc-8671-4cc8-ab66-b773584e960c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.551866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.552473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.552854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.553126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.553939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.555988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.579492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 785/1575] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.580460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.581075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.581770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.582053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.582324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.583282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.585242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.590242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a348-8c15-43d2-9177-5b80c8d9c2a9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.594971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.595889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.595889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.596102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.596718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.598619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.607709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 791/1576] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.608916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.618509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b7e1b-7ff3-4c60-8e17-5e2b2a0265ce admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.623811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.624440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.624722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.624993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.625605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.627562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.629020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 786/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.629932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.651057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 792/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.652042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.661776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ac36-56fc-40b6-962e-061838be0701 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.691901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d700e3-d92c-41ec-a495-71c961f3c4eb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.698072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.698676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.698950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.699181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.699858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.701866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.713559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.721291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.721875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.722375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.722657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.723332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.726125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.730263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 787/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.731358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.748150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 793/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.749115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.791355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:11.795341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd499c9-68e8-4c97-94a2-6bce7679c4f4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.801166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.801795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.802235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.802687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.803362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.804621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb6975-0425-4774-9369-78aa54ad56fc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.805367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.827907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 788/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.828896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.838722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568c4c-41c1-4b4d-883f-edb0c3e64c1c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.843664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.844260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.844556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.844813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.845444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.847052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.857001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.857643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 789/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:11.857822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.858196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.858434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.858842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.867821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa678b5-b9b6-4dd4-a02e-0d4bdfba0678 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.868516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.870408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.872703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.873276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.873550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.873818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.874441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.876038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.881147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 794/1583] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:11.882000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.889281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 790/1584] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:11.889281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.894867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af51c6-9f6f-49a9-b638-35a01c10e8b0 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.896793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53b02-7e94-47f9-8542-94e6bb50ee04 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.901482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.902201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.902442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.902781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.903554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.903744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.904690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.904999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.905263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.905388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.905907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.907856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.920125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 791/1585] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:11.920125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.928373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225148-7d70-4af6-b463-e8e4ad98c8d0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.934131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.934866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.935315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.935678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.939393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 795/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.939560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.939662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.939757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.951307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141f67-c57e-484e-b3ec-64f4cbb8285e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.956973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.957935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.958458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.958977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.960006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.962409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.966406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 792/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:11 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:11.966406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.978950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 796/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:11.978950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:11.987876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6e4f-dbbc-4636-8674-c15f0b366078 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.990892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31fd80-f7da-4b98-92b3-d659664f9ed3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:11.993893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.994840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.995292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.995601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.996505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:11.997328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:11.998297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:11.998410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:11.999016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:11.999016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:11.999820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.001518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.011290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 793/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.013642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 797/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.016878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.017210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.027263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af7a5-7fb8-4eed-9890-a5320f55cb45 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.029438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3abb-c0ca-4cf2-a514-241ac8c28a71 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.032823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.033599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.033980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.034369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.034703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.035356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.035468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.035684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.035964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.036604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.037493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.038517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.049517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 798/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.050921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.055694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 794/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.057405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.064169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472316-6562-44ea-88f7-93d666170db3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.070028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.074397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.074397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.074397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.074397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.076577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e348fc-6b4c-4b55-9460-bc624c5527c0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.076686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.080379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.081514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.081514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.081972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.082662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.084649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.091963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 799/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.091963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.097377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 795/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.098605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.101247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a343f-d431-485e-b023-38576199f529 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.107688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.108471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.108757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.109025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.109667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.111112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152f68c-8158-45f9-9817-2b2542bc1286 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.111291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.117226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.118132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.118581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.119486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.120398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.122268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.126058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 800/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.126058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.134613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142238a-fd78-41df-935e-c543b49791da admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.139670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 796/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.140711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.140957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.141803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.142140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.142496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] PATH_INFO: `/v3/projects/458b4efddd8d4ab4a8831ee0b3cbce08/users/a1cf493e27b3444299785f63c3b4630c/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.154443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a538f-eaf1-481a-ad7c-bc3cb50d9637 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.158585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458b4efddd8d4ab4a8831ee0b3cbce08, user_id=a1cf493e27b3444299785f63c3b4630c, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.160476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.161348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.161571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.162025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.162468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] PATH_INFO: `/v3/projects/9753ffffdc2f492999835d4fb580a982/users/0a7d69b54ced4ae9bf2614d38384a7e5/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.180559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 801/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/458b4efddd8d4ab4a8831ee0b3cbce08/users/a1cf493e27b3444299785f63c3b4630c/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.181101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9753ffffdc2f492999835d4fb580a982, user_id=0a7d69b54ced4ae9bf2614d38384a7e5, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.182652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.184373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.198856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:12.207093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 797/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/9753ffffdc2f492999835d4fb580a982/users/0a7d69b54ced4ae9bf2614d38384a7e5/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.209525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.256205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60c05-0fd9-40ab-b818-171afe24f949 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.315092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1f559-73b2-4738-81df-99d42c0adabd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.320844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.321657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.321988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.322482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.323219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.324979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.332382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.333069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.333642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.333642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] PATH_INFO: `/v3/projects/fd3c2de9259e44d89c25a4789b586b7e/users/6b185a6baab84f6d89f7f1f65551cb15/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.340195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 798/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.341006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.350751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3c2de9259e44d89c25a4789b586b7e, user_id=6b185a6baab84f6d89f7f1f65551cb15, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.353662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.366016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11132b-7d6d-4946-9cb7-892b7422e279 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.381484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 802/1600] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/fd3c2de9259e44d89c25a4789b586b7e/users/6b185a6baab84f6d89f7f1f65551cb15/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.381484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.409244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:12.451797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efbb40-5339-4157-b120-7440c007e05e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.456965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.457642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.457920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.458193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] PATH_INFO: `/v3/projects/202d6e504bb74d929dbe8c1d643c7693/users/b9d14f46c717426fa7ed83a2664043fe/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.463246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.463246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.463246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.463246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.463799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.466771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.478968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202d6e504bb74d929dbe8c1d643c7693, user_id=b9d14f46c717426fa7ed83a2664043fe, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.479597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 799/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:12.480500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.485619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69ec1-3f70-450b-a0ac-e623804efac1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.492021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883a4c-392d-4311-8406-d8dc6492877d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.498178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.499007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.499390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.499718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] PATH_INFO: `/v3/projects/c04190acd70f47e38eabb27af476c60e/users/53654fdb80a44273bf0896c4d4ae32d7/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.506691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 803/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/202d6e504bb74d929dbe8c1d643c7693/users/b9d14f46c717426fa7ed83a2664043fe/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.508290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.508911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.509342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.516540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04190acd70f47e38eabb27af476c60e, user_id=53654fdb80a44273bf0896c4d4ae32d7, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.519223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e04f07-a56d-4922-afd5-6d265d64e781 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.532276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:12.533547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:12.534192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 800/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/c04190acd70f47e38eabb27af476c60e/users/53654fdb80a44273bf0896c4d4ae32d7/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.536697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5c76-bdca-4213-bb4d-9907fa45412e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.537209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5c76-bdca-4213-bb4d-9907fa45412e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.537734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5c76-bdca-4213-bb4d-9907fa45412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.566394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:12.567335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-465c5c76-bdca-4213-bb4d-9907fa45412e None None] MFA Rules not processed for user `0a7d69b54ced4ae9bf2614d38384a7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:12.568682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-465c5c76-bdca-4213-bb4d-9907fa45412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:12.620105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 804/1604] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:12.623372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.632826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f7092-3208-45b5-8989-f1a2967673e2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.639030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.639820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.640219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.640761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] PATH_INFO: `/v3/projects/bc4609ad052d4b219f48bd4efc4715a2/users/44a18bf2bdd44bc288e388cad72e06a3/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.648235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 801/1605] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:12.649678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62b6d-314e-4fb4-b6b0-6a2f4f9e901d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.649678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62b6d-314e-4fb4-b6b0-6a2f4f9e901d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.650044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62b6d-314e-4fb4-b6b0-6a2f4f9e901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.664486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4609ad052d4b219f48bd4efc4715a2, user_id=44a18bf2bdd44bc288e388cad72e06a3, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.667182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.682897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-76b62b6d-314e-4fb4-b6b0-6a2f4f9e901d None None] MFA Rules not processed for user `6b185a6baab84f6d89f7f1f65551cb15`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:12.684054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 805/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/bc4609ad052d4b219f48bd4efc4715a2/users/44a18bf2bdd44bc288e388cad72e06a3/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.684244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76b62b6d-314e-4fb4-b6b0-6a2f4f9e901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:12.692314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.774095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 802/1607] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:12.779417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c35ee-b3c6-4ff9-925e-f4f0026d4396 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.779764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c35ee-b3c6-4ff9-925e-f4f0026d4396 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.780097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c35ee-b3c6-4ff9-925e-f4f0026d4396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.799909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b85d5-c948-47ac-80f5-fc339dd076ee admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.801797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-da8c35ee-b3c6-4ff9-925e-f4f0026d4396 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:12.803092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-da8c35ee-b3c6-4ff9-925e-f4f0026d4396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:12.804726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.805597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.805826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.806331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] PATH_INFO: `/v3/projects/dd2b4179f7e7414689bab00f12ef703d/users/e6530474477c4d20966d1cacc379ed3b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.816810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 803/1608] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:12.821369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.821721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.822122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.823890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2b4179f7e7414689bab00f12ef703d, user_id=e6530474477c4d20966d1cacc379ed3b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:12.827114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:12.845774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:12.858509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 806/1609] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:12 2022] PUT /identity/v3/projects/dd2b4179f7e7414689bab00f12ef703d/users/e6530474477c4d20966d1cacc379ed3b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:12.860145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:12.864543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] MFA Rules not processed for user `53654fdb80a44273bf0896c4d4ae32d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:12.866978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:12.930989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622ffd-87bb-4e77-8808-896e9974b573 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:12.937269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:12.937937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:12.938217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:12.938705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:12.948846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 804/1610] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:12.950126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.003895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:13.028105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89043025-b5fe-45c2-9913-0240d2ceb86e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.034085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.035105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.035613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.036098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.036992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.039398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.047660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.049659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c3e8-24aa-4092-bb55-6202ac64d494 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.067469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 807/1611] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:13.068813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.069090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.069351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.086961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 805/1612] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:13.087942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.104084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] MFA Rules not processed for user `44a18bf2bdd44bc288e388cad72e06a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:13.105541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:13.173961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d1-05f4-48f0-a599-b78823a14bf5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.179778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.181375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.182464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.182884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.183746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.186193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102349d-334c-468c-8075-5e77eb355f4e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.201075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 808/1613] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:13.201075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.201075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:13.232020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 806/1614] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:13.232826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.232953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.233192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.274747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:13.276447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:13.282537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:13.301797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7d122-b012-4d79-a84c-25dceeaaa865 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.361189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 807/1615] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:13.362615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.374902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.375703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.376180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.377242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.388450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.390363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.401107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 809/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:13.412833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.430457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676afae-703e-41e2-99f1-606c34f4823a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.435572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.436201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.436580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.437149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.438285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d535-f380-451e-8fc8-a4ccf5c26884 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.453567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.454317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.455179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.456445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.457280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.462264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.518450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 810/1617] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:13.519235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.519505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.520742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da9c18-e3a4-4561-b93a-9e28059ceb37 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.536686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:13.543938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 808/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:13.545608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761bc8-04ac-426b-ac2b-5ccab76a95fc None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.545896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761bc8-04ac-426b-ac2b-5ccab76a95fc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.546163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761bc8-04ac-426b-ac2b-5ccab76a95fc None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.549672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 809/1619] 10.222.0.26 () {54 vars in 962 bytes} [Fri Sep 2 05:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:13.556163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f761bc8-04ac-426b-ac2b-5ccab76a95fc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.556489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53607-bcad-4ed1-972a-028ec4258e3c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.567654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.568464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.568744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.569016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.569742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.576322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.590698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f761bc8-04ac-426b-ac2b-5ccab76a95fc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.598672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.599614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.600677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.601141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.626634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.628500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28239fb1-6fe6-4180-8ffd-4e987fea1599 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.637516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 811/1620] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:13.643175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.645897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 810/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:13.647453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.647966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.648443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.665760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbea65-d9f5-4cd6-928c-9c78301e6264 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.681114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.681749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.682025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.682293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.683150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.684931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.716201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 812/1622] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:13.717162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.718327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:13.719583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:13.741965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada379-63bc-4c22-b6aa-fa2723d3f5a1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.764014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.764655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.764939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.765207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.765856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.767507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.785905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 813/1623] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:13.786770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.787161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:13.809078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f114-f66c-4f9c-a0ae-36dbac26807d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:13.817253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:13.818580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:13.819053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:13.819667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] PATH_INFO: `/v3/projects/0e0018e890ff4130a681c5c41e3ff62c/users/3420da3c0e3d449796c57e3f7ddca752/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:13.844622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0018e890ff4130a681c5c41e3ff62c, user_id=3420da3c0e3d449796c57e3f7ddca752, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:13.848508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:13.947391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 811/1624] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Sep 2 05:23:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:13.947391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.950341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 814/1625] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:13 2022] PUT /identity/v3/projects/0e0018e890ff4130a681c5c41e3ff62c/users/3420da3c0e3d449796c57e3f7ddca752/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:13.950341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:13.952161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4727b82-65ad-4a2c-85de-3d7a0b4c97f5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.062717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.063389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.063758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.064030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.064814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.067470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.086247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 812/1626] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:14.087912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.096050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3fb74-1039-4e0b-891a-1dcdcfea5308 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.103890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443db54c-cceb-43fb-8ea6-1d4ae9516776 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.112403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.113319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.113943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.114536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.115515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d67778-73e1-4978-9106-635572598397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.115972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.117317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67778-73e1-4978-9106-635572598397 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.118989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.119472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67778-73e1-4978-9106-635572598397 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.122370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67778-73e1-4978-9106-635572598397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.144315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 813/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:14.149549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.174816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d975-e33d-4be4-bec6-62ab194d8ace admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.182402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.183156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.183473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.183794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] PATH_INFO: `/v3/projects/7bb01f40773a47cfa7e795f1fc1e004d/users/4c3d4c1da4964fe5afceeb50d4c4d2c4/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.213997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb01f40773a47cfa7e795f1fc1e004d, user_id=4c3d4c1da4964fe5afceeb50d4c4d2c4, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.235437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.287623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 814/1628] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:14 2022] PUT /identity/v3/projects/7bb01f40773a47cfa7e795f1fc1e004d/users/4c3d4c1da4964fe5afceeb50d4c4d2c4/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:14.292285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.340787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d67778-73e1-4978-9106-635572598397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.343316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d67778-73e1-4978-9106-635572598397 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.357319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 815/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:14.361922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.362231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.362473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.423856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] MFA Rules not processed for user `4c3d4c1da4964fe5afceeb50d4c4d2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:14.427282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:14.445443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb2baa-0c8a-4659-ada6-d9876fff3870 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.458406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.459109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.459418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.459785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] PATH_INFO: `/v3/projects/0e0018e890ff4130a681c5c41e3ff62c/users/3420da3c0e3d449796c57e3f7ddca752/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.468481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0018e890ff4130a681c5c41e3ff62c, user_id=3420da3c0e3d449796c57e3f7ddca752, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.474527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79c77-bc14-4fa7-9690-7c9187854228 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.490464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:14.520047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 815/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:14 2022] PUT /identity/v3/projects/0e0018e890ff4130a681c5c41e3ff62c/users/3420da3c0e3d449796c57e3f7ddca752/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:14.525179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.525496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.525726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.596990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] MFA Rules not processed for user `3420da3c0e3d449796c57e3f7ddca752`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:14.598244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:14.615255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 816/1631] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:14.620610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.629449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:14.645707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fbfc-d106-4812-82c0-98899bf7e83a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:14.794217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 816/1632] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:14.802777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.817328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:14.817982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:14.818911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:14.818911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:14.819438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:14.826696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:14.901224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 817/1633] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:14 2022] POST /identity/v3/projects => generated 383 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:14.904053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:14.969361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dba2f-456f-48ec-9276-9c6882736622 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.089935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.091245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.091698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.092258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.099181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a347455-9b43-45af-910a-23114ee3e7ff admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.114845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.115578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.115937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.116341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.117019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.119399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba759-4390-4c43-918c-0816ea33fa0d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.195097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 818/1634] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:14 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:15.199404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a73f2-eb67-44e8-bc15-75587f96a7d8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.199736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a73f2-eb67-44e8-bc15-75587f96a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.201813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a73f2-eb67-44e8-bc15-75587f96a7d8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.205931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 819/1635] 10.222.0.26 () {54 vars in 912 bytes} [Fri Sep 2 05:23:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:15.206877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a73f2-eb67-44e8-bc15-75587f96a7d8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.222906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.224700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d9b3-c9a0-438b-b275-8c75f4a7fe56 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.238829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a73f2-eb67-44e8-bc15-75587f96a7d8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.254561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.255236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.257830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.258125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.258799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.264291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.291766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 817/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:23:15.299261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.300276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 820/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:15.305998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.306274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.307314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.337460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1a094-005f-46dc-9161-20b71f63474f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.349243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.349934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.350569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.350849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] PATH_INFO: `/v3/projects/b5061186911f409882d3564cf90a3853/users/41fd72e58e37468cb6878d204ac5a71a/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.358027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:15.362964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:15.388931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:15.392480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5061186911f409882d3564cf90a3853, user_id=41fd72e58e37468cb6878d204ac5a71a, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.401788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.437507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 821/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:15 2022] PUT /identity/v3/projects/b5061186911f409882d3564cf90a3853/users/41fd72e58e37468cb6878d204ac5a71a/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:15.439439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.452441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:15.538177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 818/1639] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:15.539187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.560854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69a2d-3db2-4e7b-b8e8-9263df90634c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.581924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686d65e-eeec-4247-8c21-b1908db58ba1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.595588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.596334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.596695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.596971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.598869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.603458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.626545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 822/1640] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:15.627780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.692917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.696515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.696899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.697265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.715287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d48b94-d740-4f2b-a78f-c0fd039aca9c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.723074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.724022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.727378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.727813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.845038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.847852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.871310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 819/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:15.872860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:15.877497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.878976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7c33b-37ae-491a-a704-ce06302ce47d service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.897857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462747d3-8e8b-4df6-bd39-6d610a4dda7e service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:15.898149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 823/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:15.910446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:15.911441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.911839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.912356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] PATH_INFO: `/v3/projects/b5061186911f409882d3564cf90a3853/users/41fd72e58e37468cb6878d204ac5a71a/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:15.918580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5061186911f409882d3564cf90a3853, user_id=41fd72e58e37468cb6878d204ac5a71a, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:15.924297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:15.963255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 820/1643] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:15 2022] PUT /identity/v3/projects/b5061186911f409882d3564cf90a3853/users/41fd72e58e37468cb6878d204ac5a71a/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:15.971083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d5d2-e098-4592-9205-2aa1a5f7babe None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:15.971405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d5d2-e098-4592-9205-2aa1a5f7babe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:15.971859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d5d2-e098-4592-9205-2aa1a5f7babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:16.005017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3c14d5d2-e098-4592-9205-2aa1a5f7babe None None] MFA Rules not processed for user `41fd72e58e37468cb6878d204ac5a71a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:16.006520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c14d5d2-e098-4592-9205-2aa1a5f7babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:16.057264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:16.164602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 824/1644] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:16.363935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:16.486575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:16.499553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39068e-7179-431c-8459-a14d295fada2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:16.512244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:16.513441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:16.513887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:16.514325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:16.530739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:16.533698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ef13-e106-4b61-88e5-b5948ac9e90c service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:16.547363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 821/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:16.715804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e21f7-ac72-44f4-847d-e947d925f57f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:16.716503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e21f7-ac72-44f4-847d-e947d925f57f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:16.717236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e21f7-ac72-44f4-847d-e947d925f57f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:16.719172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 825/1646] 10.222.0.26 () {54 vars in 962 bytes} [Fri Sep 2 05:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:16.729743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e175-3d19-4e75-aff0-11cad7460523 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:16.730157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e175-3d19-4e75-aff0-11cad7460523 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:16.730583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e175-3d19-4e75-aff0-11cad7460523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:16.781255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e965e175-3d19-4e75-aff0-11cad7460523 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:16.783044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e965e175-3d19-4e75-aff0-11cad7460523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:17.005830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 822/1647] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Sep 2 05:23:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:17.021546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645afce-07fa-4503-860c-ac751cbbab39 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:17.022208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645afce-07fa-4503-860c-ac751cbbab39 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:17.022208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645afce-07fa-4503-860c-ac751cbbab39 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:17.023774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 826/1648] 10.222.0.26 () {54 vars in 912 bytes} [Fri Sep 2 05:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:17.031776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:17.032078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:17.032319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:17.073450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:17.075700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:17.097029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 823/1649] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:23:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:17.111741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645afce-07fa-4503-860c-ac751cbbab39 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:17.127919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645afce-07fa-4503-860c-ac751cbbab39 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:17.135551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:17.142676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:17.145093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:17.145777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:17.171986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:17.173564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:17.197665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 827/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:18.590097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:18.603392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1e199-bdbd-44a1-a0e9-827152e5878c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:18.608932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:18.610137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:18.611064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:18.612011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:18.773772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:18.775846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ef67c-595e-4711-9dc2-226bd15fbc8e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:18.803661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 824/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:22.813103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:23.068176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163017-fe38-4b31-a4c8-ef6b8ad47d9c service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:23.084889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:23.085510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:23.086332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:23.086606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] PATH_INFO: `/v3/users/44a18bf2bdd44bc288e388cad72e06a3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:23.091348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a18bf2bdd44bc288e388cad72e06a3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:23.094946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:23.216655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a18bf2bdd44bc288e388cad72e06a3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:23.245473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a18bf2bdd44bc288e388cad72e06a3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:23.292017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a18bf2bdd44bc288e388cad72e06a3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:23.293310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a18bf2bdd44bc288e388cad72e06a3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:23.321319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a18bf2bdd44bc288e388cad72e06a3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:23.339786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 828/1652] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:22 2022] DELETE /identity/v3/users/44a18bf2bdd44bc288e388cad72e06a3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:23.341310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985293-3d29-4cff-bb33-659357c16c5f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:23.341764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985293-3d29-4cff-bb33-659357c16c5f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:23.341854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985293-3d29-4cff-bb33-659357c16c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:23.403833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1e985293-3d29-4cff-bb33-659357c16c5f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:23.407735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1e985293-3d29-4cff-bb33-659357c16c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:23.649336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 825/1653] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:23.774074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:23.775947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:23.876803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:23.925376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c2f4-fbcf-4313-a4fc-34765f9a2880 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:23.930263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:23.931186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:23.931793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:23.932517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:23.945017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:23.947255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:23.971806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 829/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:24.288644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:24.288951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:24.289176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:24.366794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] MFA Rules not processed for user `ad165b2ffe474917b042bfa5d356366b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:24.369624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:24.383005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:24.550130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:24.551768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:24.604670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 826/1655] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:24.623701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:24.625889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:24.766063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa4aeb-f885-4340-9107-5719022e0b3e service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:24.786379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:24.787148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:24.787520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:24.787858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:24.795083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:24.828351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e381ed-9363-4993-a7af-70d4dbe50272 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:24.864398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:24.866154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:24.866577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:24.866896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:24.887782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:24.890282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:24.909573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 827/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:25.045932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:25.047228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:25.074631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 830/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:26.919724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:26.922173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:26.961649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:26.963826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:26.994946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfbe57-9ee8-4920-9171-c5b7e29e2dfa service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:27.003532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfb70-5219-4369-8e7e-dfae447ca365 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:27.018956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:27.021098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.031898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.032204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:27.033803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] PATH_INFO: `/v3/projects/bc4609ad052d4b219f48bd4efc4715a2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.034730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.036865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.038663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] PATH_INFO: `/v3/users/53654fdb80a44273bf0896c4d4ae32d7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.039759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4609ad052d4b219f48bd4efc4715a2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:27.044761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53654fdb80a44273bf0896c4d4ae32d7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:27.048629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:27.049677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:27.226125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53654fdb80a44273bf0896c4d4ae32d7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.252016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53654fdb80a44273bf0896c4d4ae32d7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.257523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4609ad052d4b219f48bd4efc4715a2', 'request_id': 'req-67fe5c25-a05a-4639-92c2-8cebf02166fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.280043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53654fdb80a44273bf0896c4d4ae32d7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.281813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53654fdb80a44273bf0896c4d4ae32d7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.286304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4609ad052d4b219f48bd4efc4715a2', 'request_id': 'req-67fe5c25-a05a-4639-92c2-8cebf02166fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.322692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4609ad052d4b219f48bd4efc4715a2', 'request_id': 'req-67fe5c25-a05a-4639-92c2-8cebf02166fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.343176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83de9de5-b523-4e49-acda-28305b902576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53654fdb80a44273bf0896c4d4ae32d7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.374891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] The token cache is being invalidate because project bc4609ad052d4b219f48bd4efc4715a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:27.377207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.379551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-67fe5c25-a05a-4639-92c2-8cebf02166fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:27.380293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 831/1658] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:26 2022] DELETE /identity/v3/users/53654fdb80a44273bf0896c4d4ae32d7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:27.385917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66f23-4445-4bfe-ae4f-802f4da63d6c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.386205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66f23-4445-4bfe-ae4f-802f4da63d6c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.386480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66f23-4445-4bfe-ae4f-802f4da63d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.387574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 828/1659] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:26 2022] DELETE /identity/v3/projects/bc4609ad052d4b219f48bd4efc4715a2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:27.393201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.397443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.397993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.412913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:27.442918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-caf66f23-4445-4bfe-ae4f-802f4da63d6c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:27.452971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-caf66f23-4445-4bfe-ae4f-802f4da63d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:27.499579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:27.508631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:27.545916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:27.632997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 832/1660] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:27.742859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.743657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.744450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.744546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 829/1661] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:27.753215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:27.754715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:27.808267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:27.821457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:27.855681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 833/1662] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:27.858247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:27.895064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5f85-783c-4438-92fc-3fe5e64aea22 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:27.907966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:27.952109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:27.966982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:27.973608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:27.977351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:27.980017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:27.988049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.013389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5e06-eef0-4947-8f7b-a514b37b76c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.029665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 834/1663] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:28.033145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:28.057632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.060569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.061857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.066750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.121909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744660-77a4-4842-8cd2-56bdd7023be4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.149140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.155972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.160277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.162380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.164222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.167242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.167955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.174836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.179682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 830/1664] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:28.276980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 835/1665] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:28 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:28.281842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:28.294964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee655283-f44e-4fb3-9e8e-b85c21a1510b service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.503605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.504236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.504518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.504787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.506079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.508312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.574867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 831/1666] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:28 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:28.575365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:28.590602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e169d-308f-41e5-80e8-175107c86019 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.608148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.609112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.609610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.610065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.610907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.612784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.636711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 836/1667] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:23:28.640643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:28.654930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78831f-34ac-4e54-95d9-8e8391ce06f4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.672336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.673303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.673303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.673491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.674148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.676737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e8218-46cd-4879-823b-045d0fd69cfe admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.704244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:28.705275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 832/1668] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:28.719433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90b04-ddfb-43a0-861b-6604df23043e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:28.733910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:28.734967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.735615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.736099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] PATH_INFO: `/v3/projects/10586dd5a300423e89ef8d87cc957c4f/users/124af6ea40fc4414be0a5b63288c6eeb/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.773742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10586dd5a300423e89ef8d87cc957c4f, user_id=124af6ea40fc4414be0a5b63288c6eeb, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:28.776760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e634be-e95f-4824-bcf4-165970f4e86f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:28.814805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 837/1669] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:28 2022] PUT /identity/v3/projects/10586dd5a300423e89ef8d87cc957c4f/users/124af6ea40fc4414be0a5b63288c6eeb/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:28.816858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.817146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.817451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.835564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:28.835957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:28.836327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:28.876450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] MFA Rules not processed for user `124af6ea40fc4414be0a5b63288c6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:28.879382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:28.921823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] MFA Rules not processed for user `a1cf493e27b3444299785f63c3b4630c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:28.925236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:28.962959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:29.070298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 833/1670] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:29.075619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.114957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 838/1671] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:29.116493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.119297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.141455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:29.323181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd59c-f8f3-4a57-8a00-4c6ae36c73b0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.334700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdd1b8-b00d-4c11-89aa-5efc8373b848 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.340608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.342846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.343666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.344407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] PATH_INFO: `/v3/users/6b185a6baab84f6d89f7f1f65551cb15` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.346905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b185a6baab84f6d89f7f1f65551cb15)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.368534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:29.373678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.374524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.374934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.377455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.378148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.383468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08628c80-51dd-47c8-90a0-06a85777bbd0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:29.503909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 834/1672] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:29 2022] POST /identity/v3/projects => generated 387 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:29.510908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a56c-4b92-4976-8369-88e6c0f78e3e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.511328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a56c-4b92-4976-8369-88e6c0f78e3e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.513711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a56c-4b92-4976-8369-88e6c0f78e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.533659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b185a6baab84f6d89f7f1f65551cb15'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:29.544434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b185a6baab84f6d89f7f1f65551cb15'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:29.556783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b185a6baab84f6d89f7f1f65551cb15'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:29.557341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b185a6baab84f6d89f7f1f65551cb15'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:29.575947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b185a6baab84f6d89f7f1f65551cb15'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:29.579512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0f39a56c-4b92-4976-8369-88e6c0f78e3e None None] MFA Rules not processed for user `a1cf493e27b3444299785f63c3b4630c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:29.585167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0f39a56c-4b92-4976-8369-88e6c0f78e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.586611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 839/1673] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:29 2022] DELETE /identity/v3/users/6b185a6baab84f6d89f7f1f65551cb15 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:29.590747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.592300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.662445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 835/1674] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:29.664679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.665124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.666014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.692029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e0f2-9878-4765-9100-5803fb25f7ba admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.701104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.701881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.702808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.703087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.705157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.708166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:29.711285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:29.713364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.726077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 836/1675] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:29.727114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.730593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.747733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 840/1676] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:29 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:29.751704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.765170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0319-138d-415e-b0e0-1c0f070cf5d9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.773889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.774959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.775645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.776254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.777165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.779240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:29.800129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 841/1677] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:29.801447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:29.804617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.825413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:29.874335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:29.927966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1c03c-c500-470d-8803-b2a1c4df49ad None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.929793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606eb2-e05f-4406-9505-69bafa2880de admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:29.943449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.943568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:29.943838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.944209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.944553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:29.944919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.945606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:29.947114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:29.952202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:29.976167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.978210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:29.988438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:29.990245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:30.012382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 842/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:30.013249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:30.032194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 837/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:30.040575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90485-4899-4afe-b279-8c5c2661bdb4 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:30.053237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:30.054560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.054870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.055123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] PATH_INFO: `/v3/projects/7ceb1901a2834462b42fb101bf076f97/users/daac4e57f18340e19d890eb7e0163bb1/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.125757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ceb1901a2834462b42fb101bf076f97, user_id=daac4e57f18340e19d890eb7e0163bb1, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:30.136337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0885-02e4-4c43-ab8f-497ea9d9fba7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:30.170704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 843/1680] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:30 2022] PUT /identity/v3/projects/7ceb1901a2834462b42fb101bf076f97/users/daac4e57f18340e19d890eb7e0163bb1/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:30.174830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:30.198033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac58-8aa5-402d-b76f-ff4130cb8705 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:30.200331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.201080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.201080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.300395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] MFA Rules not processed for user `b9d14f46c717426fa7ed83a2664043fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:30.301903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:30.353510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:30.354653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.355393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.355931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.356929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:30.358821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b752f-35ff-4c90-8da5-83fab40da10d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:30.386370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 838/1681] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:30.388033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.388317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.388586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.429639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] MFA Rules not processed for user `ad165b2ffe474917b042bfa5d356366b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:30.431661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:30.520259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 844/1682] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:30.520259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:30.541025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcdb0b-a0aa-422f-b00c-54bc5ebc92cb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:30.555442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:30.555856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.556132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.556400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] PATH_INFO: `/v3/projects/7ceb1901a2834462b42fb101bf076f97/users/daac4e57f18340e19d890eb7e0163bb1/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.560152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ceb1901a2834462b42fb101bf076f97, user_id=daac4e57f18340e19d890eb7e0163bb1, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:30.565836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e554d8-ab23-431f-88fd-cdd6fd19f171 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:30.583113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 839/1683] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:30.583970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:30.593819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 845/1684] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:30 2022] PUT /identity/v3/projects/7ceb1901a2834462b42fb101bf076f97/users/daac4e57f18340e19d890eb7e0163bb1/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:30.597304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:30.604183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:30.604711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:30.606239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:30.695052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] MFA Rules not processed for user `daac4e57f18340e19d890eb7e0163bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:30.695052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:30.810522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea27c3-4a77-4a03-8a41-d7ef5953a6f7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:30.868590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:30.891322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:30.910242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 846/1685] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:30.911505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:30.914886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:31.019617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:31.020284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.020564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.020849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.136878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f90f9-0e34-4492-8ffe-8fc27a371a24 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:31.161813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:31.164645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.166260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.166694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:31.167773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] PATH_INFO: `/v3/projects/c04190acd70f47e38eabb27af476c60e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.169201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:31.174027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04190acd70f47e38eabb27af476c60e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:31.180123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 840/1686] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:31.180893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:31.181388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:31.181388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: warnings.warn(msg) Sep 02 05:23:31.181388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: Sep 02 05:23:31.182360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:31.184794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:31.315028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf08698-f8e0-4493-8594-2c6426ab5ec1 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:31.345347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04190acd70f47e38eabb27af476c60e', 'request_id': 'req-2e823a26-1909-4302-b268-eed0c8ada9ff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:31.380526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04190acd70f47e38eabb27af476c60e', 'request_id': 'req-2e823a26-1909-4302-b268-eed0c8ada9ff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:31.395867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04190acd70f47e38eabb27af476c60e', 'request_id': 'req-2e823a26-1909-4302-b268-eed0c8ada9ff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:31.496859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] The token cache is being invalidate because project c04190acd70f47e38eabb27af476c60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:31.498356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:31.501587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e823a26-1909-4302-b268-eed0c8ada9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:31.504400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 847/1687] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:30 2022] DELETE /identity/v3/projects/c04190acd70f47e38eabb27af476c60e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:31.512218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45589d5-c1b7-46e6-bb8f-5be4b3513eee None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.515677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45589d5-c1b7-46e6-bb8f-5be4b3513eee None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.516009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45589d5-c1b7-46e6-bb8f-5be4b3513eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.553740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:31.554394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.554689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.554947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.564543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:31.608435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f45589d5-c1b7-46e6-bb8f-5be4b3513eee None None] MFA Rules not processed for user `e6530474477c4d20966d1cacc379ed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:31.616205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f45589d5-c1b7-46e6-bb8f-5be4b3513eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:31.633329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:31.826882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:31.828394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6f872-a2be-4c45-9545-9f0b3260adfd service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:31.880338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 848/1688] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:31.882394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54b2-6672-4d02-969e-2deb6f4919d9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.882693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54b2-6672-4d02-969e-2deb6f4919d9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.882972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54b2-6672-4d02-969e-2deb6f4919d9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.885135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 849/1689] 10.222.0.26 () {54 vars in 912 bytes} [Fri Sep 2 05:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:31.886258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e5ab-fc9c-4d23-b777-5e9a06b453b2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.886696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e5ab-fc9c-4d23-b777-5e9a06b453b2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.886982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e5ab-fc9c-4d23-b777-5e9a06b453b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.898832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 841/1690] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:31.900370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9047-6629-42a0-8471-c6f60ad431c2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:31.900652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9047-6629-42a0-8471-c6f60ad431c2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:31.900922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9047-6629-42a0-8471-c6f60ad431c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:31.920005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-91f2e5ab-fc9c-4d23-b777-5e9a06b453b2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:31.921261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-91f2e5ab-fc9c-4d23-b777-5e9a06b453b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:31.945139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:31.961689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c5eb9047-6629-42a0-8471-c6f60ad431c2 None None] MFA Rules not processed for user `e6530474477c4d20966d1cacc379ed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:31.963768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c5eb9047-6629-42a0-8471-c6f60ad431c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.008324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 842/1691] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:32.008324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.008324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.008324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.122471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:32.126000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.164830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 850/1692] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:32.166268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.166568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.166847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.226287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:32.227581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.256007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 851/1694] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:32.256202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 843/1694] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:32.257257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.259340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.259816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.263599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.280645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc1f0e-58b3-497f-a27c-75539169d1ee None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.286046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.286840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.287323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.287869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] PATH_INFO: `/v3/projects/fd3c2de9259e44d89c25a4789b586b7e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.289646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3c2de9259e44d89c25a4789b586b7e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.291841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.312454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c98bc3-a3da-48b5-b4f0-498703cf115f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.322686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.323664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.323956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.324231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] PATH_INFO: `/v3/users/124af6ea40fc4414be0a5b63288c6eeb` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.330069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124af6ea40fc4414be0a5b63288c6eeb)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.334153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.407311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3c2de9259e44d89c25a4789b586b7e', 'request_id': 'req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.428694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3c2de9259e44d89c25a4789b586b7e', 'request_id': 'req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.439223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124af6ea40fc4414be0a5b63288c6eeb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.450326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3c2de9259e44d89c25a4789b586b7e', 'request_id': 'req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.471963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124af6ea40fc4414be0a5b63288c6eeb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.478910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] The token cache is being invalidate because project fd3c2de9259e44d89c25a4789b586b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:32.479165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.479867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.485667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 844/1695] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:32 2022] DELETE /identity/v3/projects/fd3c2de9259e44d89c25a4789b586b7e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:32.485667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.485667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.494538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124af6ea40fc4414be0a5b63288c6eeb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.495512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124af6ea40fc4414be0a5b63288c6eeb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.528148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:32.543435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124af6ea40fc4414be0a5b63288c6eeb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.553507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 852/1696] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:32 2022] DELETE /identity/v3/users/124af6ea40fc4414be0a5b63288c6eeb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:32.554388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.555804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.576285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7b5de-fa09-4ff1-85ae-c39187dd18aa admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.647059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02055c6-c835-4bcc-80d5-27dc719185f4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.652439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.653612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.654301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.654705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.658615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.672901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.673558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.673863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.674280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.675462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:32.675769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.677584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fe69-c165-42ff-9726-c3ebf8fd9f13 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.691638 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.695453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 845/1697] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:32.695453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.695453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.695453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.695738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bef34-795a-4748-a6bd-39c3329e01a0 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.701296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 846/1698] 10.222.0.26 () {54 vars in 912 bytes} [Fri Sep 2 05:23:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:32.702245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.704044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.723823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 853/1699] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:32.725314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.725588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.725858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.753805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2a72-ee9a-42bf-a04e-98a0cb0b18ed None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.755411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:32.756725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.762854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.763646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.763972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.764250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] PATH_INFO: `/v3/users/4c3d4c1da4964fe5afceeb50d4c4d2c4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.765674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3d4c1da4964fe5afceeb50d4c4d2c4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.766709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 05:23:32.766709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: warnings.warn(msg) Sep 02 05:23:32.766709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: Sep 02 05:23:32.768093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.771797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 854/1700] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:32.772839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.774703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.793076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93258ece-82b5-46f4-b2d3-0a8a2ec5c79b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:32.799533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:32.801090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.801090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.801090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.802701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:32.806343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b16f49-fa4b-4050-8832-23f5a842279a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:32.827464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:32.857564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 855/1701] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:32 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:32.859960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:32.860762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:32.861305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:32.870490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3d4c1da4964fe5afceeb50d4c4d2c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.893161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3d4c1da4964fe5afceeb50d4c4d2c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.894564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:32.896509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:32.904645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3d4c1da4964fe5afceeb50d4c4d2c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.905274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3d4c1da4964fe5afceeb50d4c4d2c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.906607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3d4c1da4964fe5afceeb50d4c4d2c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:32.930764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 847/1702] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:32 2022] DELETE /identity/v3/users/4c3d4c1da4964fe5afceeb50d4c4d2c4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:32.930764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:32.930764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.008975 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 856/1703] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:33.010494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.016004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.084914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:33.130945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd936-d82a-4de4-85d7-5e2c9625b82d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.139120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.139822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.140097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.140392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.145818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.183901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ff11-c8dd-4886-9945-c0c3fc28468a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.247388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.248988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.256563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.257580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.257943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.258315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.259735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.262061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.262854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 848/1704] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:33.275929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.281587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.297738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4864cd-0e14-4685-a9db-077cf33f2df4 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.304152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 857/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:33 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:33.306952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.318773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.320441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.323397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.324518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.335315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c1b-cefb-47af-84a1-856e9cad667d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.346375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.347044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.347364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.347636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.348410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.353211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.356769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.358430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.383871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 849/1706] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:33.387154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 858/1707] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:33.388264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.419174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.425365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.437822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35264a-0417-4828-9b59-dacead39dd4e service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.457390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e1f8-a8aa-4a3f-a618-f7f64c6d4f6f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.468604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.469735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.470015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.470283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.479461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.481897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.483669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.485257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.486872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.487258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] PATH_INFO: `/v3/projects/7bb01f40773a47cfa7e795f1fc1e004d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.492358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb01f40773a47cfa7e795f1fc1e004d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.497357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.540102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 850/1708] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:33.541295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.595464 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:33.601921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad164db-909f-42e8-aa9c-0bb8ab075fd2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:33.633673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:33.642448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.642967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.644061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] PATH_INFO: `/v3/projects/b3fb3438d36e4e308163f8bb8262d98f/users/9d98e2303c614a4ea14699402f3d278f/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.656804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb01f40773a47cfa7e795f1fc1e004d', 'request_id': 'req-036f1535-c996-44a8-b457-f315b18f8053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:33.670864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb01f40773a47cfa7e795f1fc1e004d', 'request_id': 'req-036f1535-c996-44a8-b457-f315b18f8053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:33.675721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fb3438d36e4e308163f8bb8262d98f, user_id=9d98e2303c614a4ea14699402f3d278f, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:33.678657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6ac69-b098-41a1-a2f9-f72bc451d69c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:33.681114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb01f40773a47cfa7e795f1fc1e004d', 'request_id': 'req-036f1535-c996-44a8-b457-f315b18f8053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:33.697496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 851/1709] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:33 2022] PUT /identity/v3/projects/b3fb3438d36e4e308163f8bb8262d98f/users/9d98e2303c614a4ea14699402f3d278f/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:33.714294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:33.714630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] The token cache is being invalidate because project 7bb01f40773a47cfa7e795f1fc1e004d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:33.714943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:33.715746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:33.715877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:33.716661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:33.721558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 859/1710] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:33 2022] DELETE /identity/v3/projects/7bb01f40773a47cfa7e795f1fc1e004d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:33.723133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:33.724823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.816743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] MFA Rules not processed for user `9d98e2303c614a4ea14699402f3d278f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:33.818874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:33.950095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1535-c996-44a8-b457-f315b18f8053 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.026292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 852/1711] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:34.027336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.028683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.082199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:34.090731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.091801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.092283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.092746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] PATH_INFO: `/v3/users/41fd72e58e37468cb6878d204ac5a71a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.094392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fd72e58e37468cb6878d204ac5a71a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.096697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.146752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19492bdd-cca6-4beb-884f-5e6c695aedb4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.155419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.156575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.157159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.157710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.161214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.207867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fd72e58e37468cb6878d204ac5a71a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.223551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fd72e58e37468cb6878d204ac5a71a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.237729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:34.241604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fd72e58e37468cb6878d204ac5a71a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.243518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fd72e58e37468cb6878d204ac5a71a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.276628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fd72e58e37468cb6878d204ac5a71a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.294543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 860/1712] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:33 2022] DELETE /identity/v3/users/41fd72e58e37468cb6878d204ac5a71a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:34.296449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.296914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.299902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.300533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.329746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 853/1713] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:34.331686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.334704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.460822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c9e5-5cb8-489c-ab9a-df9390abfb4b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.477315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.477962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.478233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.478507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.479154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.481230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.515099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641323-b10d-4ee9-b295-944317f29016 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.543741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 861/1714] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:34 2022] POST /identity/v3/projects => generated 405 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:34.547418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.549670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.603777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.604995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.605482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.606340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.611461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:34.627619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.631656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.646232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 854/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:34.647452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.654706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:34.663947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a6eb-ade0-4e8a-ba05-3383eb3c9658 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.674459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.675483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.675977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.676455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.676828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86664dfe-6708-469d-8f0f-1419668fefdc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.677732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.682341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e4176-752a-4da3-a064-eb7aefb59437 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.688465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.689142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.689430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.689713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] PATH_INFO: `/v3/projects/10586dd5a300423e89ef8d87cc957c4f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.695229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10586dd5a300423e89ef8d87cc957c4f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.697409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:34.749378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 855/1716] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:34 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:34.753908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db92af3-d5ea-4f36-bbdc-7796a14ba62a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.754424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db92af3-d5ea-4f36-bbdc-7796a14ba62a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.754868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db92af3-d5ea-4f36-bbdc-7796a14ba62a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.757611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 856/1717] 10.222.0.26 () {54 vars in 961 bytes} [Fri Sep 2 05:23:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:34.758535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db92af3-d5ea-4f36-bbdc-7796a14ba62a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:34.798357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db92af3-d5ea-4f36-bbdc-7796a14ba62a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:34.835485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10586dd5a300423e89ef8d87cc957c4f', 'request_id': 'req-b34b07ed-1e3b-492f-ae3e-c91e8908346b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.885868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10586dd5a300423e89ef8d87cc957c4f', 'request_id': 'req-b34b07ed-1e3b-492f-ae3e-c91e8908346b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.919702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10586dd5a300423e89ef8d87cc957c4f', 'request_id': 'req-b34b07ed-1e3b-492f-ae3e-c91e8908346b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.925057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:34.970483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] The token cache is being invalidate because project 10586dd5a300423e89ef8d87cc957c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:34.973698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.977160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b34b07ed-1e3b-492f-ae3e-c91e8908346b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:34.984994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 862/1718] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:34 2022] DELETE /identity/v3/projects/10586dd5a300423e89ef8d87cc957c4f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:34.987166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.987754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.988314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:34.988849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.989531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:34.989809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:34.990075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:34.990755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:34.999995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:35.044666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:35.047728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.053167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 857/1719] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:35.054337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:35.061331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.116095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e5af-bf6d-4cb6-a21d-25df0717f4be admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:35.147631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:35.148306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:35.148585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:35.148867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] PATH_INFO: `/v3/users/daac4e57f18340e19d890eb7e0163bb1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:35.187048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daac4e57f18340e19d890eb7e0163bb1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:35.191912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:35.195741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 863/1720] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Sep 2 05:23:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:35.196933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:35.206556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.263986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e381-fc91-4408-925e-6cc973d3b799 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:35.283321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:35.286386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:35.286673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:35.289787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] PATH_INFO: `/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65/users/9945497365eb432f91ba717f08f4c763/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:35.332940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa6e615428b4bc5aaa18dc4e3dc2c65, user_id=9945497365eb432f91ba717f08f4c763, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:35.342491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:35.367517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daac4e57f18340e19d890eb7e0163bb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.381306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 864/1721] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:35 2022] PUT /identity/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65/users/9945497365eb432f91ba717f08f4c763/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:35.384048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:35.412247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daac4e57f18340e19d890eb7e0163bb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.432457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daac4e57f18340e19d890eb7e0163bb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.433178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daac4e57f18340e19d890eb7e0163bb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.434349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daac4e57f18340e19d890eb7e0163bb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.457289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 858/1722] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:35 2022] DELETE /identity/v3/users/daac4e57f18340e19d890eb7e0163bb1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:35.458399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:35.468005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.603709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:35.628722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f387-de93-48dd-b5ee-67fe9fe34884 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:35.643887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:35.648919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:35.649522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:35.649871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] PATH_INFO: `/v3/projects/b5061186911f409882d3564cf90a3853` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:35.651684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5061186911f409882d3564cf90a3853)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:35.654510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:35.661503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd4eff-7f1e-42cc-acfa-aa7a1a18d12b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:35.765936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5061186911f409882d3564cf90a3853', 'request_id': 'req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.773519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:35.774157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:35.774436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:35.774758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:35.776633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.787763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5061186911f409882d3564cf90a3853', 'request_id': 'req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.793534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:35.795810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:35.801274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:35.802956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5061186911f409882d3564cf90a3853', 'request_id': 'req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.829108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] The token cache is being invalidate because project b5061186911f409882d3564cf90a3853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:35.830153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.830302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 865/1723] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:35.830393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4ae48a0-e3c6-4825-8d43-3f3e6635e650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:35.831377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:35.836323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 859/1724] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:35 2022] DELETE /identity/v3/projects/b5061186911f409882d3564cf90a3853 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:35.836500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.837917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193d92-2b30-4a85-8981-57937db9c552 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:35.838201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193d92-2b30-4a85-8981-57937db9c552 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:35.838476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193d92-2b30-4a85-8981-57937db9c552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:35.876535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7d193d92-2b30-4a85-8981-57937db9c552 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:35.879402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d193d92-2b30-4a85-8981-57937db9c552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:35.883424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f113-0224-4637-a448-ecc7e426b9f9 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.026381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 860/1725] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:36.028384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.028587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.028861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.086809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:36.087463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.088113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.088391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.088662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.089316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.092428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:36.100450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.113776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 861/1726] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:36.117949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.141618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014162a7-3990-4bd3-8612-26df9841cedd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.153777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 866/1727] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:36.155226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.156576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.158496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.158913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.159131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:36.159399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.160170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:36.160572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.165577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.181963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6905ad-1959-4c9a-9d5f-bacee5f632f7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.210163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 862/1728] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:36.211612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.225485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f619e-db42-40dc-a6ba-6d5937fb8f7d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.226188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.226927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.227224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.227512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] PATH_INFO: `/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65/users/9945497365eb432f91ba717f08f4c763/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.230157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.231896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.232621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.232977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.233662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.236494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.242921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa6e615428b4bc5aaa18dc4e3dc2c65, user_id=9945497365eb432f91ba717f08f4c763, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.261530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d674eca-d740-4efb-b72e-121d5f0d730f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.303306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 863/1729] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:36 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:36.305580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.334603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 867/1730] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:36 2022] PUT /identity/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65/users/9945497365eb432f91ba717f08f4c763/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:36.337802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.338242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.339180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.445066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:36.451238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] MFA Rules not processed for user `9945497365eb432f91ba717f08f4c763`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:36.472128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:36.545532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f19b-6f4c-4be0-8e99-1ed89b8ad0c8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.558077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.558840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.559671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.560038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.560779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.565178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf7820-5783-429e-9428-71513b0af387 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.609098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 864/1731] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:36 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:36.611223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.611785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.612665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.676168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] MFA Rules not processed for user `b9d14f46c717426fa7ed83a2664043fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:36.679597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:36.745322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 868/1732] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:36.746832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.753379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:36.801473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499e78-2b5c-47ce-b161-5593dcdc9d5f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.816539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.817366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.817691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.822013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] PATH_INFO: `/v3/projects/7ceb1901a2834462b42fb101bf076f97` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.835614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ceb1901a2834462b42fb101bf076f97)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.842031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.868359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 865/1733] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:36.869713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.886210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dbb2b-5082-4562-9a11-3c491725a244 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:36.896120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:36.896837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:36.899417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:36.900182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:36.902550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:36.914840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:36.967522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 866/1734] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:36.985339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:36.991752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.004372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ceb1901a2834462b42fb101bf076f97', 'request_id': 'req-af845bc7-761e-4659-ae7c-cec6a9c3904a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:37.027482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ceb1901a2834462b42fb101bf076f97', 'request_id': 'req-af845bc7-761e-4659-ae7c-cec6a9c3904a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:37.044444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:37.050991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ceb1901a2834462b42fb101bf076f97', 'request_id': 'req-af845bc7-761e-4659-ae7c-cec6a9c3904a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:37.080792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] The token cache is being invalidate because project 7ceb1901a2834462b42fb101bf076f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:37.081733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:37.083664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:37.092894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 869/1735] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:36 2022] DELETE /identity/v3/projects/7ceb1901a2834462b42fb101bf076f97 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:37.094143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:37.096350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.198461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901a49-4d75-4dc1-8110-80d49a5aec2e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:37.309069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845bc7-761e-4659-ae7c-cec6a9c3904a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:37.319893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:37.320533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.320921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.321195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.321931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:37.323570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46445-c988-4885-b1e4-d3c8dc4657fe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:37.354376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 870/1736] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:37.354376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045049f-82fe-493c-afb7-b4703e19f0ad None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.354376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045049f-82fe-493c-afb7-b4703e19f0ad None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.354376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045049f-82fe-493c-afb7-b4703e19f0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.360063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:37.362306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.362701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.364164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.372154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.415823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6045049f-82fe-493c-afb7-b4703e19f0ad None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:37.417085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6045049f-82fe-493c-afb7-b4703e19f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.454144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 871/1737] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:37.455712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098bc1e-53f5-40ac-ab1c-3c7e1e0f57d1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.456033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098bc1e-53f5-40ac-ab1c-3c7e1e0f57d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.456311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098bc1e-53f5-40ac-ab1c-3c7e1e0f57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.487591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:37.523916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a098bc1e-53f5-40ac-ab1c-3c7e1e0f57d1 None None] MFA Rules not processed for user `e6530474477c4d20966d1cacc379ed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:37.526907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a098bc1e-53f5-40ac-ab1c-3c7e1e0f57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.568767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:37.572255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:37.591449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 867/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:37.592323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:37.608470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220186b-75be-4787-b246-083d084dcbb8 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:37.616659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:37.617360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.617635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.617905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] PATH_INFO: `/v3/projects/41402dc80bbb408bbca7dbd95141455e/users/b0e05933be9448cc8ca14d72dc74fc6c/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.671164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41402dc80bbb408bbca7dbd95141455e, user_id=b0e05933be9448cc8ca14d72dc74fc6c, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:37.678197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648fc98-f76a-48ec-bef1-40ecf0735107 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:37.704011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 868/1739] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:37 2022] PUT /identity/v3/projects/41402dc80bbb408bbca7dbd95141455e/users/b0e05933be9448cc8ca14d72dc74fc6c/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:37.712090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.712434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.712846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.727326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 872/1740] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:37.739295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.740735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.741174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.772159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:37.773645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.813719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] MFA Rules not processed for user `b0e05933be9448cc8ca14d72dc74fc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:37.815553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.880520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 869/1741] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:37.881677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:37.883361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:37.901237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bace052-a2ca-49aa-8945-e0230d7df3ae None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:37.912441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:37.914543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:37.916554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:37.916847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] PATH_INFO: `/v3/users/9d98e2303c614a4ea14699402f3d278f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:37.921429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d98e2303c614a4ea14699402f3d278f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:37.926555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.055260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 873/1742] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:38.055260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.065485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d98e2303c614a4ea14699402f3d278f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:38.096015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c08f54-beeb-4bf8-945b-4dc75490b05d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.105344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d98e2303c614a4ea14699402f3d278f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:38.107030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.107721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.108060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.108387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.109047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:38.110461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.110999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.133819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d98e2303c614a4ea14699402f3d278f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:38.137491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d98e2303c614a4ea14699402f3d278f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:38.139672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d98e2303c614a4ea14699402f3d278f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:38.142343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:38.148346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 874/1743] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:38.149338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.159381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:38.178499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 870/1744] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:37 2022] DELETE /identity/v3/users/9d98e2303c614a4ea14699402f3d278f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:38.180496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.183674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:38.197873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb020-ed6c-4973-8b2c-5ca4362697f6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.266125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:38.411548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343db7-f252-4ce0-99cc-ccadaed0144c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.419608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.420260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.420550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.420825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.421486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.423510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d772e6-9e0c-48f4-8e8e-c8f5dbb2b562 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.429989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.430636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.430914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.431186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.431858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.433888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.482767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 875/1745] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/projects => generated 387 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:38.486853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.487149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.487437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.498540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 871/1746] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/projects => generated 407 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:38.500166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.564521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:38.572568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:38.716835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c9dd-6ffd-4338-8fe5-145c8bc03448 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.725453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.726133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.726812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.727095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.728679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.732064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.766164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 872/1747] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:38.767179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.768603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 876/1748] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:38.771814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.784575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989431-64b6-41dd-8f50-ab393e309e6f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.785163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7969a3-5897-4993-9945-f07c08199898 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.790900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.791025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.791564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.791702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.791837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.792109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.792580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.792869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.794340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.796481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.804133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.809967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.836902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 873/1749] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/users => generated 304 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:38.836902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.840517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:38.850982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 877/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:38.851876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.870944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21d70-3761-422b-b2a3-d4c798205cd3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.889668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.891155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.891479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.892442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.893108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.900911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.931620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37359f8f-9dda-4fcb-9981-c5f435e93721 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:38.936263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:38.937013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.937544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.937828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:38.950916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:38.953165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2fde2-d64d-4bbf-967e-48ef4002223f service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:38.966593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 878/1751] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:38.967583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:38.973838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 874/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:38.975845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:38.976362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:38.976840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.004914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b7b4-5a4a-4953-b2fa-6223abef7a37 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:39.025748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:39.026458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.026740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.028792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] PATH_INFO: `/v3/projects/50077f07d1e5434d8a692000783b75fb/users/0d3a1ec8db21406f9c645eb0309c1994/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.058835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:39.066124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50077f07d1e5434d8a692000783b75fb, user_id=0d3a1ec8db21406f9c645eb0309c1994, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:39.071420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:39.106568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 879/1753] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:38 2022] PUT /identity/v3/projects/50077f07d1e5434d8a692000783b75fb/users/0d3a1ec8db21406f9c645eb0309c1994/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:39.106568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:39.117608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:39.120578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:39.252160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:39.295918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a1175-3fcf-4284-a67a-383303af2d69 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:39.304289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:39.305137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.307534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.307965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.308767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:39.310605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:39.351880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 880/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:39.360151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:39.383946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93176b-433d-4f38-b89a-cdf8b75bc53d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:39.390010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 875/1755] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:39.394258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:39.395282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:39.398160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.399839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.400197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.402385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:39.407140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:39.448826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 881/1756] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:39.451027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:39.454681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df6e0a-0e8e-4c69-8271-8479d9dea048 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:39.478285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:39.482430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.483393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.484011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] PATH_INFO: `/v3/projects/2ad9cb1d48964a1c95629590b0a0f927/users/85b76e61c9ef4c87a605ebe20f8cdbb8/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.501134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec54e-2624-4f4c-b84c-a26c4d9692f5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:39.511925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:39.514339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.514694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.515543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] PATH_INFO: `/v3/projects/50077f07d1e5434d8a692000783b75fb/users/0d3a1ec8db21406f9c645eb0309c1994/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.518916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50077f07d1e5434d8a692000783b75fb, user_id=0d3a1ec8db21406f9c645eb0309c1994, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:39.522749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec28f99-e25a-43fd-bd52-0007daedbf39 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:39.562418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 882/1757] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:39 2022] PUT /identity/v3/projects/50077f07d1e5434d8a692000783b75fb/users/0d3a1ec8db21406f9c645eb0309c1994/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:39.563910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.565660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.565937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.597459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad9cb1d48964a1c95629590b0a0f927, user_id=85b76e61c9ef4c87a605ebe20f8cdbb8, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:39.599304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ecb5a-12a7-486b-904f-0441ed264fb5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:39.659858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 876/1758] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:39 2022] PUT /identity/v3/projects/2ad9cb1d48964a1c95629590b0a0f927/users/85b76e61c9ef4c87a605ebe20f8cdbb8/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:39.673225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:39.673225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:39.673225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:39.675949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] MFA Rules not processed for user `0d3a1ec8db21406f9c645eb0309c1994`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:39.682422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:39.796744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] MFA Rules not processed for user `85b76e61c9ef4c87a605ebe20f8cdbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:39.800560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:39.993165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 883/1759] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:40.009472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:40.017552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:40.079060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 877/1760] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:39 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:40.082333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:40.085600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:40.223360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff3ee5-5176-4724-a97f-031a745dba14 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:40.231225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:40.234410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:40.237631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:40.238021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:40.261835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080bf0b-7cf3-4af0-82f1-ae29ff34e768 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:40.276440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:40.280859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:40.282254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:40.287287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:40.287842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:40.288267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:40.293413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:40.305128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 878/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:40.307042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:40.336064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:40.477915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:40.482312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:40.502004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 884/1762] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:23:40.561366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5e933-fcb5-411d-b461-56aaab778a7e service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:40.579822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:40.581869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:40.583994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:40.584729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:40.588348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:40.594907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:40.683251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:40.684996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:40.745075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 879/1763] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:40 2022] POST /identity/v3/projects => generated 407 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:40.745891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:40.749405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dd9e-26ee-4f3b-83c9-df862e203d93 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:41.014205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:41.014960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:41.020717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:41.021054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] PATH_INFO: `/v3/projects/b3fb3438d36e4e308163f8bb8262d98f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:41.024721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fb3438d36e4e308163f8bb8262d98f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:41.033436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:41.049469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391171c4-1f4c-48d3-aa24-ec40475ad86e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:41.072410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:41.073262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:41.073863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:41.074247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] PATH_INFO: `/v3/users/b0e05933be9448cc8ca14d72dc74fc6c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:41.077578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e05933be9448cc8ca14d72dc74fc6c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:41.079766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:41.228867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fb3438d36e4e308163f8bb8262d98f', 'request_id': 'req-1b560a4d-8873-4a24-8bb8-92f7c74ce065'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.246142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e05933be9448cc8ca14d72dc74fc6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.249428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fb3438d36e4e308163f8bb8262d98f', 'request_id': 'req-1b560a4d-8873-4a24-8bb8-92f7c74ce065'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.293680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fb3438d36e4e308163f8bb8262d98f', 'request_id': 'req-1b560a4d-8873-4a24-8bb8-92f7c74ce065'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.327452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e05933be9448cc8ca14d72dc74fc6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.346047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] The token cache is being invalidate because project b3fb3438d36e4e308163f8bb8262d98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:41.346047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.346047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.346047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 885/1764] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:40 2022] DELETE /identity/v3/projects/b3fb3438d36e4e308163f8bb8262d98f => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:41.346047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:41.346711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:41.356292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e05933be9448cc8ca14d72dc74fc6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.363618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e05933be9448cc8ca14d72dc74fc6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.368242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e05933be9448cc8ca14d72dc74fc6c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:41.405086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 880/1765] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:40 2022] DELETE /identity/v3/users/b0e05933be9448cc8ca14d72dc74fc6c => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:41.412280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:41.417891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:41.446356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:41.572140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:41.671509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b560a4d-8873-4a24-8bb8-92f7c74ce065 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:41.841781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902a91-0fc0-4d0b-b904-26e592a55323 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:41.877901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:41.879495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:41.879773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:41.880047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] PATH_INFO: `/v3/users/9945497365eb432f91ba717f08f4c763` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:41.882227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9945497365eb432f91ba717f08f4c763)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:41.885078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:41.999485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9945497365eb432f91ba717f08f4c763'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:42.081695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9945497365eb432f91ba717f08f4c763'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:42.099710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9945497365eb432f91ba717f08f4c763'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:42.100945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9945497365eb432f91ba717f08f4c763'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:42.101578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:42.101947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0190c837-edc2-4a1b-84d3-b167c31d0553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9945497365eb432f91ba717f08f4c763'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:42.104898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:42.106030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:42.108399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:42.112387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:42.114631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:42.153168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 881/1766] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:41 2022] DELETE /identity/v3/users/9945497365eb432f91ba717f08f4c763 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:42.155945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553879e5-d495-439c-bdc2-32282f975134 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:42.156446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553879e5-d495-439c-bdc2-32282f975134 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:42.156781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553879e5-d495-439c-bdc2-32282f975134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:42.207779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 886/1767] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:41 2022] POST /identity/v3/users => generated 310 bytes in 869 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:42.213634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:42.243012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:42.249609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-553879e5-d495-439c-bdc2-32282f975134 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:42.254179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-553879e5-d495-439c-bdc2-32282f975134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:42.299183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87afc3-8b49-4620-b43e-486b67449882 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:42.612542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 882/1768] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:42.624552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:42.625161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:42.625669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:42.626370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:42.628534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:42.634662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:42.679612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 887/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:42.684254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553879e5-d495-439c-bdc2-32282f975134 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:42.698867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553879e5-d495-439c-bdc2-32282f975134 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:42.710927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:42.711740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:42.712123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:42.714174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] PATH_INFO: `/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f/users/0328ca124a87447f82a5fe34db869d30/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:42.753358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8233d8c4a73e486f9eeb247b2cf25f4f, user_id=0328ca124a87447f82a5fe34db869d30, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:42.761099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:42.766603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:42.769158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:42.842230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:42.867226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 883/1770] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:42 2022] PUT /identity/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f/users/0328ca124a87447f82a5fe34db869d30/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:42.870574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:43.087187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429fb8f-dd24-4fd0-b7ca-53eba2c3692a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:43.212912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f6ae7-5b67-4d5d-993e-4e3dbd8223c6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:43.233876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:43.234678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.235089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.237592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.238451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:43.242280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:43.283485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:43.296880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 884/1771] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:23:43.301688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:43.337114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ffd67-de30-4e47-a59f-bdbd8028ffbb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:43.345407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:43.346321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.348452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.348987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.356490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:43.357185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.357467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.357742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] PATH_INFO: `/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f/users/0328ca124a87447f82a5fe34db869d30/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.363837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8233d8c4a73e486f9eeb247b2cf25f4f, user_id=0328ca124a87447f82a5fe34db869d30, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:43.369997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fca84-1030-4c24-8c1c-9f6f329d4fed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:43.375465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:43.377109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4336-b12f-4659-abec-db58fbdff7f0 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:43.400327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 885/1772] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:43 2022] PUT /identity/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f/users/0328ca124a87447f82a5fe34db869d30/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:43.401197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 888/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:43.410741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.411072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.411421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.485216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] MFA Rules not processed for user `0328ca124a87447f82a5fe34db869d30`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:43.486462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:43.504897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.505189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.505490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.581766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:43.581766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:43.745551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 886/1774] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:43 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:43.758414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 889/1775] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Sep 2 05:23:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:43.767046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:43.768357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:43.901404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3d568-fe09-41a1-bf51-a6710a295e7d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:43.921020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:43.921845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:43.924555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:43.925708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:43.962604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:43.969473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:44.022176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:44.024029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:44.029907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 887/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:43 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:23:44.057520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693cec-8fe4-42c5-94d8-d6137274902d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:44.087596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:44.088250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:44.088534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:44.089184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:44.135423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:44.141026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:44.165926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:44.169190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:44.170677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 890/1777] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:23:44.210934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:44.477869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62581f71-e4ee-47ef-b554-199261337dbc service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:44.494971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:44.496454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:44.496937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:44.497045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] PATH_INFO: `/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:44.498932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa6e615428b4bc5aaa18dc4e3dc2c65)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:44.504152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:44.596276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:44.597897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:44.638279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a563d5-b748-4ffc-a733-4a4e43e0e52f service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:44.677165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa6e615428b4bc5aaa18dc4e3dc2c65', 'request_id': 'req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:44.693541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa6e615428b4bc5aaa18dc4e3dc2c65', 'request_id': 'req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:44.712504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa6e615428b4bc5aaa18dc4e3dc2c65', 'request_id': 'req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:44.737952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] The token cache is being invalidate because project 1fa6e615428b4bc5aaa18dc4e3dc2c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:44.738190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:44.742009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2b9c3c0b-f571-45cf-88e4-18b3f9f220c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:44.746529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 888/1778] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:44 2022] DELETE /identity/v3/projects/1fa6e615428b4bc5aaa18dc4e3dc2c65 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:44.752168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453edb-d079-48f4-b754-75188b2b3494 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:44.752453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453edb-d079-48f4-b754-75188b2b3494 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:44.752735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453edb-d079-48f4-b754-75188b2b3494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:44.825555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-92453edb-d079-48f4-b754-75188b2b3494 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:44.830125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-92453edb-d079-48f4-b754-75188b2b3494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:44.843068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:44.843764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:44.844048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:44.844321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:44.853549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:45.098057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 889/1779] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:45.106092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.106917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.107491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.127694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.129269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.154852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 891/1780] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:44 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:23:45.157277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:45.159598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:45.196023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 890/1781] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:45.203160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.229157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6428b12-5b99-4437-ae7f-32c1f2877692 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.252091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.252976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.258772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.259362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.260381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:45.264307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.266224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.318663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 892/1782] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:45.323075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.341484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c031212-4f4f-4ced-b697-c73a5f0d232c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.384422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.385410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.385875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.387246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.389308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.394431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.461159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 891/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:45 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:45.466445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.482914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58e25-9f0a-457f-babd-72fd6411b704 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.514260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:45.630489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.631428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.631827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.632204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.632999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.637572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.697524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.704769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 893/1784] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:45 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:23:45.714690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be11d4-616f-4985-8a7f-4c8b75839457 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.729345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.730100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.730483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.731104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.731926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.733872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.769261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 892/1785] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:23:45.773228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.788537 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1df949-705f-47b3-86da-e01eec8871bb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.817718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.818352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.818805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.820535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:45.821387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:45.823840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1c04-46ac-4927-bda8-dae3d0d2283c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:45.902604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 894/1786] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:45.904966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:45.919896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:45.941237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62c9a0-aa6c-48f7-8fff-2b4a4c86cb17 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:45.954423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:45.956319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:45.956607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:45.958171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] PATH_INFO: `/v3/projects/67447438b15c4bdca17a1f59370e9e6e/users/575bf5d14e3949fa80770a556661a0a1/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:46.025344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67447438b15c4bdca17a1f59370e9e6e, user_id=575bf5d14e3949fa80770a556661a0a1, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:46.033235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:46.103738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:46.104008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:46.104474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:46.104827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 893/1787] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:45 2022] PUT /identity/v3/projects/67447438b15c4bdca17a1f59370e9e6e/users/575bf5d14e3949fa80770a556661a0a1/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:46.215738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] MFA Rules not processed for user `575bf5d14e3949fa80770a556661a0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:46.217487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:46.448266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 895/1788] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:46.448823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:46.710966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b849-848a-41b1-af45-0f07f1e8173b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:46.729048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:46.729962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:46.730408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:46.731403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:46.732743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:46.744584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:46.839356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 894/1789] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:46 2022] POST /identity/v3/projects => generated 365 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:46.841886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:46.861511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a8d1-357c-4cfa-a038-ff7b14576d93 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:47.056427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:47.057266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.057588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.058104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.058943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:47.064225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:47.116855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 896/1790] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:46 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:47.121391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:47.136122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4f5c-d178-4fcb-86ec-e38d0d6844e1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:47.148007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:47.158146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.160057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.163393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.164117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:47.170114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:47.214288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 895/1791] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:47.218723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:47.237241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856db3-5dbe-4e00-9734-cf5c3bdde848 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:47.244782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:47.245769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.247471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.247958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] PATH_INFO: `/v3/projects/1339d558c6d3494cb6792c627ce9f028/users/07ae9b304537413688f6bdfedc1f870f/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.319846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:47.322846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1339d558c6d3494cb6792c627ce9f028, user_id=07ae9b304537413688f6bdfedc1f870f, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:47.331228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:47.394139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 897/1792] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:47 2022] PUT /identity/v3/projects/1339d558c6d3494cb6792c627ce9f028/users/07ae9b304537413688f6bdfedc1f870f/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:47.395746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:47.412708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987191d-9bfc-4ca0-b935-ca00e062f52d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:47.651794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:47.654851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.655459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.655737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.656408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:47.661601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015184e-e907-47dd-b56d-d078e0db5465 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:47.699077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 896/1793] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:47.704143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:47.736619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13116f4-b6bf-467c-858e-b2ab93cb44f4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:47.754846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:47.756088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.756465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.756696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] PATH_INFO: `/v3/projects/1339d558c6d3494cb6792c627ce9f028/users/07ae9b304537413688f6bdfedc1f870f/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.764440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1339d558c6d3494cb6792c627ce9f028, user_id=07ae9b304537413688f6bdfedc1f870f, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:47.772274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e2651-d6d5-4f19-9a0a-a0aae5038513 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:47.816320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471bce-f7b8-40db-907f-8037ebd4632a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:47.816832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471bce-f7b8-40db-907f-8037ebd4632a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:47.817243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471bce-f7b8-40db-907f-8037ebd4632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:47.834639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 898/1794] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:47 2022] PUT /identity/v3/projects/1339d558c6d3494cb6792c627ce9f028/users/07ae9b304537413688f6bdfedc1f870f/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:47.914807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ae471bce-f7b8-40db-907f-8037ebd4632a None None] MFA Rules not processed for user `07ae9b304537413688f6bdfedc1f870f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:47.927762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae471bce-f7b8-40db-907f-8037ebd4632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:48.083410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:48.228174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:48.228810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:48.228972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:48.231420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 899/1795] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:23:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:23:48.235488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:48.239467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:48.336191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 897/1796] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:48.341628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:48.345009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:48.347424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:48.437681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:48.442371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:48.516913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99fa4-3932-4b80-a486-acdecf948b18 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:48.543174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:48.544261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:48.544766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:48.545175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] PATH_INFO: `/v3/projects/41402dc80bbb408bbca7dbd95141455e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:48.546756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41402dc80bbb408bbca7dbd95141455e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:48.552575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:48.673206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 898/1797] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:48.675256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:48.679164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:48.694550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41402dc80bbb408bbca7dbd95141455e', 'request_id': 'req-82de8ee1-ddae-486d-8678-72f5fa640d22'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:48.723788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41402dc80bbb408bbca7dbd95141455e', 'request_id': 'req-82de8ee1-ddae-486d-8678-72f5fa640d22'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:48.739087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41402dc80bbb408bbca7dbd95141455e', 'request_id': 'req-82de8ee1-ddae-486d-8678-72f5fa640d22'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:48.774930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] The token cache is being invalidate because project 41402dc80bbb408bbca7dbd95141455e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:48.775354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:48.777947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:48.782144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 900/1798] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:48 2022] DELETE /identity/v3/projects/41402dc80bbb408bbca7dbd95141455e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:48.782817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:48.787096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:48.837765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ae59-f9d9-435e-9d3a-f972e4c5c0f0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:49.001995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:49.002248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:49.003338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:49.003683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:49.008763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:49.031736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8ee1-ddae-486d-8678-72f5fa640d22 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:49.072579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:49.073450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:49.076164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:49.076164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:49.083246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:49.110118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:49.127819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:49.140435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:49.145033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:49.186588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:49.189203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:49.195677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 901/1799] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:49.196585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:49.204210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:49.221186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 899/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:49.446281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d00-10fc-4d96-87d4-000aae7f5afb service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:49.453978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:49.455522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:49.456056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:49.456552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] PATH_INFO: `/v3/users/0d3a1ec8db21406f9c645eb0309c1994` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:49.462851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3a1ec8db21406f9c645eb0309c1994)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:49.466235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:49.581098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3a1ec8db21406f9c645eb0309c1994'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:49.598087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3a1ec8db21406f9c645eb0309c1994'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:49.617496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3a1ec8db21406f9c645eb0309c1994'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:49.618710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3a1ec8db21406f9c645eb0309c1994'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:49.653209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-705b32f2-7cec-4a4c-9406-8d245df23c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3a1ec8db21406f9c645eb0309c1994'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:49.670323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 902/1801] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:49 2022] DELETE /identity/v3/users/0d3a1ec8db21406f9c645eb0309c1994 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:50.954358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:50.955880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:50.985907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd6c0-f911-41e6-ac35-cfbbff04405f service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:51.120172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:51.121393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:51.121832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:51.122326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] PATH_INFO: `/v3/users/575bf5d14e3949fa80770a556661a0a1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:51.123821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575bf5d14e3949fa80770a556661a0a1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:51.140323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:51.286906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575bf5d14e3949fa80770a556661a0a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:51.314241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575bf5d14e3949fa80770a556661a0a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:51.322305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575bf5d14e3949fa80770a556661a0a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:51.323189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575bf5d14e3949fa80770a556661a0a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:51.330482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-689330c9-34ee-4017-8d34-d029431968b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575bf5d14e3949fa80770a556661a0a1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:51.358691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 900/1802] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:50 2022] DELETE /identity/v3/users/575bf5d14e3949fa80770a556661a0a1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:51.362965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:51.364316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:51.364607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:51.409115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:51.420053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:51.584697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 903/1803] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:51.849984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e893d-6525-47f4-889e-41d2908f4034 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:51.850279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e893d-6525-47f4-889e-41d2908f4034 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:51.850554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e893d-6525-47f4-889e-41d2908f4034 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:51.852235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 901/1804] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:23:51.909546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:51.911652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:51.934179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:51.936414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:51.936888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:51.941626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:51.986799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:51.991176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:52.062822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2b73-0d0a-4dfb-b184-b903a162b4d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:52.073410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:52.077720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:52.078186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:52.079179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:52.110834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:52.120321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:52.151514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:52.159160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 904/1805] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:52.248789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 902/1806] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:23:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:52.645219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:52.648115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:52.667048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f3c2-9560-4bb1-90d7-66405928051b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:52.694188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:52.695037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:52.695445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:52.695727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:52.699781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:52.705007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:52.709833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:52.711966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2ea73-ef49-487b-b48e-e71424ce8fff service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:52.727148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 905/1807] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:52.729334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2df7-66fe-4c9c-8208-e106f0f4b494 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:52.736167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:52.736938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:52.737217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:52.737488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] PATH_INFO: `/v3/projects/50077f07d1e5434d8a692000783b75fb` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:52.738690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50077f07d1e5434d8a692000783b75fb)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:52.740825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:52.804789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50077f07d1e5434d8a692000783b75fb', 'request_id': 'req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:52.816600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50077f07d1e5434d8a692000783b75fb', 'request_id': 'req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:52.826733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50077f07d1e5434d8a692000783b75fb', 'request_id': 'req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:52.866469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] The token cache is being invalidate because project 50077f07d1e5434d8a692000783b75fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:52.866791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:52.867788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-903976b6-cd1f-4773-be6b-d87cf0ee2b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:52.873986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 903/1808] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:52 2022] DELETE /identity/v3/projects/50077f07d1e5434d8a692000783b75fb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:52.875645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a55db-f11b-4457-8220-50120fb78337 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:52.876261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a55db-f11b-4457-8220-50120fb78337 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:52.876748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a55db-f11b-4457-8220-50120fb78337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:52.987718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-145a55db-f11b-4457-8220-50120fb78337 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:52.993440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-145a55db-f11b-4457-8220-50120fb78337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:53.184878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 906/1809] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:53.193283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.193872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.193872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.224608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:53.227032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:53.241962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 904/1810] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:53.247131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a55db-f11b-4457-8220-50120fb78337 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:53.260566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a55db-f11b-4457-8220-50120fb78337 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:53.281812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:53.282072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.282493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.282708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.283543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:53.283850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:53.286231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:53.317741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 907/1811] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:53.318996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:53.362597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311032a-45e4-44cd-a74f-ad99a4bd04ca None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:53.402983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:53.410730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.411352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.411818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.421716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:53.431570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:53.445613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:53.447376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:53.502535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e8a2-f8cc-453b-83db-6228f6ddba79 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:53.529048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:53.531568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.531858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.532145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] PATH_INFO: `/v3/users/85b76e61c9ef4c87a605ebe20f8cdbb8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.542342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b76e61c9ef4c87a605ebe20f8cdbb8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:53.550733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:53.587313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 905/1812] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:53 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:53.593460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:53.679988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b76e61c9ef4c87a605ebe20f8cdbb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:53.697697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b76e61c9ef4c87a605ebe20f8cdbb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:53.714958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b76e61c9ef4c87a605ebe20f8cdbb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:53.717967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b76e61c9ef4c87a605ebe20f8cdbb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:53.756424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7f92e832-f929-4022-9d36-dfcef21da260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b76e61c9ef4c87a605ebe20f8cdbb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:53.764358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a95-5b5e-45af-8249-3686f58e1517 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:53.775329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 908/1813] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:53 2022] DELETE /identity/v3/users/85b76e61c9ef4c87a605ebe20f8cdbb8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:53.776708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:53.777757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.777877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.778127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.778819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:53.781587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:53.781816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:53.782178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:53.786564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:53.798259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:53.832347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:53.834451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:53.842694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 906/1814] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:53 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:53.844159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:53.849000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:53.877622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f730-0e1d-4b04-a740-3242cbc96344 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:53.959808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:54.026421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 909/1815] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:54.051811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.053030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.054370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.054940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.056035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.058596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.077980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:54.089612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 907/1816] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:54.091268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03fcc-f49d-4ab1-9653-b8a11f3aad02 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:54.098260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.099055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.099552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.099959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.100804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.103079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.121335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:54.122389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 910/1817] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:54.139457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40801ad3-5947-43b1-a75f-2bd086489b6c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:54.165745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.167422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.167704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.168036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] PATH_INFO: `/v3/projects/d082e8cfcf3949b0b7490427dbbd72cb/users/29bbba3f02374fac884e3fca3faad152/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.191302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d082e8cfcf3949b0b7490427dbbd72cb, user_id=29bbba3f02374fac884e3fca3faad152, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.193023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:54.196699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:54.199578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f33d-e68f-4b52-b2ac-ea970d20626b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.237229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 908/1818] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:54 2022] PUT /identity/v3/projects/d082e8cfcf3949b0b7490427dbbd72cb/users/29bbba3f02374fac884e3fca3faad152/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:54.254486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.255062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.255506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.304990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] MFA Rules not processed for user `29bbba3f02374fac884e3fca3faad152`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:54.306292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:54.356952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6ba83-adbe-401d-99ed-d6b2e14efe2c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:54.388405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 909/1819] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:54.403110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:54.405270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:54.458057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.458852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.459216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.460482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.484040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc2e7-7c05-4c76-8d5c-99b19b737c50 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:54.488610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.489140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.489319 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.489838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.502891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.504685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.520483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 910/1820] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:54.542515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.545456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.552341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:54.591513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 911/1821] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:54.860459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:54.862200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:54.887804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082fc3e-4855-4d02-bb81-02d227b09c96 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:54.894563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:54.895296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:54.895632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:54.895906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] PATH_INFO: `/v3/projects/67447438b15c4bdca17a1f59370e9e6e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:54.897199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67447438b15c4bdca17a1f59370e9e6e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:54.900160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:54.940290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:54.969891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67447438b15c4bdca17a1f59370e9e6e', 'request_id': 'req-9a0444c0-5911-41b9-9653-3c7124edb29d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:54.970130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67447438b15c4bdca17a1f59370e9e6e', 'request_id': 'req-9a0444c0-5911-41b9-9653-3c7124edb29d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:54.995566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67447438b15c4bdca17a1f59370e9e6e', 'request_id': 'req-9a0444c0-5911-41b9-9653-3c7124edb29d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.017849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] The token cache is being invalidate because project 67447438b15c4bdca17a1f59370e9e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:55.018500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.019633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.021549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 911/1822] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:54 2022] DELETE /identity/v3/projects/67447438b15c4bdca17a1f59370e9e6e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:55.026721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:55.043621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60fd6-103e-45ca-8467-67b286d4d316 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:55.124253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:55.124925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:55.126623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:55.126623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] PATH_INFO: `/v3/users/07ae9b304537413688f6bdfedc1f870f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:55.127128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ae9b304537413688f6bdfedc1f870f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:55.129262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:55.194398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ae9b304537413688f6bdfedc1f870f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.202963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ae9b304537413688f6bdfedc1f870f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.210523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ae9b304537413688f6bdfedc1f870f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.211182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ae9b304537413688f6bdfedc1f870f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.223688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ae9b304537413688f6bdfedc1f870f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.231070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 912/1823] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:55 2022] DELETE /identity/v3/users/07ae9b304537413688f6bdfedc1f870f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:55.316183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:55.318230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:55.333730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0444c0-5911-41b9-9653-3c7124edb29d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:55.415691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:55.416251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:55.416617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:55.416797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] PATH_INFO: `/v3/projects/2ad9cb1d48964a1c95629590b0a0f927` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:55.418414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad9cb1d48964a1c95629590b0a0f927)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:55.420468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:55.476646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad9cb1d48964a1c95629590b0a0f927', 'request_id': 'req-4e1b3beb-37fb-4431-b982-8ac591e05fe1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.483945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad9cb1d48964a1c95629590b0a0f927', 'request_id': 'req-4e1b3beb-37fb-4431-b982-8ac591e05fe1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.490033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad9cb1d48964a1c95629590b0a0f927', 'request_id': 'req-4e1b3beb-37fb-4431-b982-8ac591e05fe1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.503880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] The token cache is being invalidate because project 2ad9cb1d48964a1c95629590b0a0f927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:55.504192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.504862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.506691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 912/1824] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:55 2022] DELETE /identity/v3/projects/2ad9cb1d48964a1c95629590b0a0f927 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:55.510603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:55.512176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:55.525191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b6bf-f592-496d-be7c-ea7bff467760 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:55.570527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:55.572815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:55.604770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:55.605596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:55.606980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:55.607310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] PATH_INFO: `/v3/users/0328ca124a87447f82a5fe34db869d30` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:55.609125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0328ca124a87447f82a5fe34db869d30)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:55.611290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:55.638825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:55.668046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:55.694024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3beb-37fb-4431-b982-8ac591e05fe1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:55.705878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0328ca124a87447f82a5fe34db869d30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.713517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:55.717755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:55.719236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:55.719236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] PATH_INFO: `/v3/projects/1339d558c6d3494cb6792c627ce9f028` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:55.720739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1339d558c6d3494cb6792c627ce9f028)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:55.726353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:55.728605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0328ca124a87447f82a5fe34db869d30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.745315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0328ca124a87447f82a5fe34db869d30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.746421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0328ca124a87447f82a5fe34db869d30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.790009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0186303f-385c-4d03-ba72-a11c10a2d858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0328ca124a87447f82a5fe34db869d30'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.801826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 913/1825] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:55 2022] DELETE /identity/v3/users/0328ca124a87447f82a5fe34db869d30 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:55.830474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1339d558c6d3494cb6792c627ce9f028', 'request_id': 'req-72596a6c-9502-4147-8b87-fc1b222d010d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.833249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1339d558c6d3494cb6792c627ce9f028', 'request_id': 'req-72596a6c-9502-4147-8b87-fc1b222d010d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.842789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1339d558c6d3494cb6792c627ce9f028', 'request_id': 'req-72596a6c-9502-4147-8b87-fc1b222d010d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.860471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] The token cache is being invalidate because project 1339d558c6d3494cb6792c627ce9f028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:55.860787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.861542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-72596a6c-9502-4147-8b87-fc1b222d010d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:55.863331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 913/1826] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:55 2022] DELETE /identity/v3/projects/1339d558c6d3494cb6792c627ce9f028 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:55.868145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:55.868513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:55.869259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:55.910001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:55.912029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:55.992151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 914/1827] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:56.001901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.002358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.002707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.040486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:56.040486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.051807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 914/1828] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:56.052834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.069124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e3bc-f501-4960-ac0d-cf9a6ba6c306 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.087002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.087676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.087959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.088235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.088898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:56.089200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.091939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.108229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 915/1829] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:23:56.111700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.135554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9eaa7-c218-4309-97e3-7bb68b1a97a3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.135554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.135554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.135554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.135893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.135893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.135893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.179531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 915/1830] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:56.180551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.198605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.199906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137932b9-e7cb-4fe4-8f6d-5ec94c3616fa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.200806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.303439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.304061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.304338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.304625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.305326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.307307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.321951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02b2a-3b26-45d3-82e1-b70fc7a719c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.327807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.328622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.328903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.329272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] PATH_INFO: `/v3/users/0a7d69b54ced4ae9bf2614d38384a7e5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.330520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7d69b54ced4ae9bf2614d38384a7e5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.332723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.339511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 916/1831] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:56.340800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.342594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.365739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02132fd-13ae-4a82-bead-f5e95a24c311 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.383741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.384217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.385069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.385362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] PATH_INFO: `/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.387413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8233d8c4a73e486f9eeb247b2cf25f4f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.389581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.399717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:56.419057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7d69b54ced4ae9bf2614d38384a7e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.421518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:56.443020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7d69b54ced4ae9bf2614d38384a7e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.453972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7d69b54ced4ae9bf2614d38384a7e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.455192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7d69b54ced4ae9bf2614d38384a7e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.456088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7d69b54ced4ae9bf2614d38384a7e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.489384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 916/1832] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:56 2022] DELETE /identity/v3/users/0a7d69b54ced4ae9bf2614d38384a7e5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:23:56.492388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.493765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.505847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8233d8c4a73e486f9eeb247b2cf25f4f', 'request_id': 'req-e2aaa94e-cad6-4161-8560-46865f09b512'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.516790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8233d8c4a73e486f9eeb247b2cf25f4f', 'request_id': 'req-e2aaa94e-cad6-4161-8560-46865f09b512'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.523985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8233d8c4a73e486f9eeb247b2cf25f4f', 'request_id': 'req-e2aaa94e-cad6-4161-8560-46865f09b512'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.539025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] The token cache is being invalidate because project 8233d8c4a73e486f9eeb247b2cf25f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:56.539606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.540451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e2aaa94e-cad6-4161-8560-46865f09b512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:56.543248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 917/1833] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:56 2022] DELETE /identity/v3/projects/8233d8c4a73e486f9eeb247b2cf25f4f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:56.543685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0754-3488-48ca-9923-bb60d340137b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.544125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0754-3488-48ca-9923-bb60d340137b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.544414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0754-3488-48ca-9923-bb60d340137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.567849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6d1e0754-3488-48ca-9923-bb60d340137b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:56.569344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6d1e0754-3488-48ca-9923-bb60d340137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.577331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c63e81-fd99-400d-a54c-042059086ddf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.578594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 918/1834] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:56.580023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.580313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.580588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.582771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.583541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.583826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.584099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.584767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.586366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.598187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 917/1835] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:56.599102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.603565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.605951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:56.607586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.616006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 919/1836] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:56.623956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.625374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.637555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb777720-ac0c-464c-bb67-cc4883c73a09 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.644183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.645157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.645511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.645855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.646786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.649142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2875b82-a789-4864-911d-bfde03c20286 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.663316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 920/1837] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:56.663316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889458-efca-4258-a336-ba786e4f2854 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.663316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889458-efca-4258-a336-ba786e4f2854 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.663316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889458-efca-4258-a336-ba786e4f2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.673155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8eec-0d21-409f-aa19-02348a787d8c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.676681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.677309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.677580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.677844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.681516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-75889458-efca-4258-a336-ba786e4f2854 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:56.682719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-75889458-efca-4258-a336-ba786e4f2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.686906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.688474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.691058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 921/1838] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:56.691862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75889458-efca-4258-a336-ba786e4f2854 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.697934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 918/1839] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:56.698729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.701561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75889458-efca-4258-a336-ba786e4f2854 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.706397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.707069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.707383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.707655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] PATH_INFO: `/v3/projects/91938bc6805748139ff83fef403342da/users/970efea033794da7b7aa83c918af4976/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.707771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e035b-0575-4d6f-96fe-e629423994fb service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.712420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.713015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.713287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.713554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.714187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:56.714484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.716246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.723106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91938bc6805748139ff83fef403342da, user_id=970efea033794da7b7aa83c918af4976, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.725818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e43a20-b1ee-4e0e-a275-5ff74254a857 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.731589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 919/1840] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:56.733236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.744498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 922/1841] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:56 2022] PUT /identity/v3/projects/91938bc6805748139ff83fef403342da/users/970efea033794da7b7aa83c918af4976/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:56.744709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa7a06-af65-4763-84a7-5b0f6b618f25 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.754974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.755304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.755586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.803311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] MFA Rules not processed for user `970efea033794da7b7aa83c918af4976`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:56.804649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:56.806430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:56.819481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.820194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.820573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.820937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.821770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.824026 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:56.868576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 920/1842] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:23:56.873523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.904870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 923/1843] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:23:56.910223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:56.922587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40356bb-1b60-481c-b22c-a4faf1400a62 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.957493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2acb-46ff-4d5d-a92d-e8db1eb65dbf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:56.961764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:56.963741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:56.964377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:56.964791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:56.965119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:56.965937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:56.968652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.001853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 921/1844] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:57.006405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.012948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.013974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.014281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.014538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.015273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.018398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.022469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7c0d9-1f12-43d5-ace5-65d11f1aa078 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.029603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.030316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.032946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.032946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.032946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.034315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.047249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 922/1845] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:57.051454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.056052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 924/1846] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:56 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:23:57.057227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.062930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ec2fa-ffe6-400a-be6e-64afd247f570 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.146828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed2f7-e102-499d-b874-245bdddd4fed admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.152669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.153599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.153887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.154395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.155115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.156214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.156829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.157103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.157192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.157369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.158008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.159649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.180394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 923/1847] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:57.180394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.182787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.190722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 925/1848] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:57 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:23:57.190722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.201803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888736-ff9c-49e8-98c8-d925c00fd6fa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.205658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35505-6603-4493-83e2-282c32d7b7e4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.209369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.212065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.212875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.213542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] PATH_INFO: `/v3/projects/9984ab55be3744eb8983d1def2a1744b/users/f4915cf26e61499391ff6854e3382ea6/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.215355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.217437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.219361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.220398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] PATH_INFO: `/v3/projects/9753ffffdc2f492999835d4fb580a982` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.225335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9753ffffdc2f492999835d4fb580a982)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.239051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9984ab55be3744eb8983d1def2a1744b, user_id=f4915cf26e61499391ff6854e3382ea6, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.241614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.242269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.271384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 926/1849] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:57 2022] PUT /identity/v3/projects/9984ab55be3744eb8983d1def2a1744b/users/f4915cf26e61499391ff6854e3382ea6/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:57.272868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.393036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:57.399105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9753ffffdc2f492999835d4fb580a982', 'request_id': 'req-79f71ef0-c449-4631-981d-30958b6f56ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.406730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc08a2-a660-401a-922d-5a24f3b7492e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.410743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9753ffffdc2f492999835d4fb580a982', 'request_id': 'req-79f71ef0-c449-4631-981d-30958b6f56ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.421394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9753ffffdc2f492999835d4fb580a982', 'request_id': 'req-79f71ef0-c449-4631-981d-30958b6f56ac'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.476836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:57.479042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] The token cache is being invalidate because project 9753ffffdc2f492999835d4fb580a982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:57.479431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.485991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-79f71ef0-c449-4631-981d-30958b6f56ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.493691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 924/1850] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:57 2022] DELETE /identity/v3/projects/9753ffffdc2f492999835d4fb580a982 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:57.496126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.496478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.496826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.529674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.530608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.532174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.532174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.532174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.534774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.550876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 927/1851] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:57.550876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.554203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.568240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] MFA Rules not processed for user `f4915cf26e61499391ff6854e3382ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:57.570494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.593175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589043-f51c-4ad9-9eb5-caf677d05e8a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.605788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.607872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.609161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.609577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] PATH_INFO: `/v3/users/3420da3c0e3d449796c57e3f7ddca752` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.612636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3420da3c0e3d449796c57e3f7ddca752)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.615127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.708240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3420da3c0e3d449796c57e3f7ddca752'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.710692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3420da3c0e3d449796c57e3f7ddca752'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.720941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3420da3c0e3d449796c57e3f7ddca752'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.728630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3420da3c0e3d449796c57e3f7ddca752'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.739306 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 925/1852] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:57.740427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.745496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.747504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3420da3c0e3d449796c57e3f7ddca752'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:57.767448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 928/1853] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:23:57 2022] DELETE /identity/v3/users/3420da3c0e3d449796c57e3f7ddca752 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:57.768299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996d9c-184f-47cc-b8d5-8738dba63d9e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.770723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.773512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.862565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.866412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.867151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.867496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b3fd-236c-4e99-a298-4feb503e68e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:57.867851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] PATH_INFO: `/v3/projects/2a43e6cc596d45a6b07a13829e6399df/users/ae20210947fb464e86d4cb807e0e3cae/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.876091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:57.877331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:57.877814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:57.878268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:57.879728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.882225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.898320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a43e6cc596d45a6b07a13829e6399df, user_id=ae20210947fb464e86d4cb807e0e3cae, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:57.906906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:57.930599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 926/1854] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:57 2022] PUT /identity/v3/projects/2a43e6cc596d45a6b07a13829e6399df/users/ae20210947fb464e86d4cb807e0e3cae/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:57.932155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.934092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:57.939060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 929/1855] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:57 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:57.940168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:57.982794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:58.027849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:58.056483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9916-640b-49fa-966d-8d60bbeb9bb9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.065756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.066301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a724f-84cf-4435-bbde-a68bb35dd143 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.067957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.068445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.069380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.070716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.072167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.073043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.073327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.073594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.074038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.074722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.076679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.092868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 927/1856] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:58.097624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.106147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 930/1857] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:57 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:58.107354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.110798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb59c-5314-4843-9d71-97d0f4571e99 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.117011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.117735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.118211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.118632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069704-789a-4b3e-bbdf-185c7f4edbce admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.118748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] PATH_INFO: `/v3/projects/2a43e6cc596d45a6b07a13829e6399df/users/ae20210947fb464e86d4cb807e0e3cae/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.121420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a43e6cc596d45a6b07a13829e6399df, user_id=ae20210947fb464e86d4cb807e0e3cae, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.124653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.125028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.125401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.125729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.126005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.127024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.130484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce773be1-b82a-47e6-a8dd-cb7766c4bcdb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.147824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 928/1858] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:58 2022] PUT /identity/v3/projects/2a43e6cc596d45a6b07a13829e6399df/users/ae20210947fb464e86d4cb807e0e3cae/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:58.148057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 931/1859] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:58.149071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.149739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.150132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.150448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.193955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] MFA Rules not processed for user `ae20210947fb464e86d4cb807e0e3cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:58.195477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.230576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56bf54-d1bb-4a45-9f8f-5dd88241e526 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.236081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.236836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.237114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.237428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] PATH_INFO: `/v3/projects/40ff00434a41499fbf8ba957d8fa4425/users/a49fdb6ff80c4d79b168710c4cbf95e5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.258461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff00434a41499fbf8ba957d8fa4425, user_id=a49fdb6ff80c4d79b168710c4cbf95e5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.263578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.288688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 929/1860] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:58 2022] PUT /identity/v3/projects/40ff00434a41499fbf8ba957d8fa4425/users/a49fdb6ff80c4d79b168710c4cbf95e5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:58.289755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.291992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.296733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 932/1861] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:58.297725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.320042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1778-2201-4008-b8e9-babe28ba004b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.384693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1872dd4-32de-46c4-bb30-9e4e6268a588 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.395077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.397382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.397813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.398242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] PATH_INFO: `/v3/projects/0e0018e890ff4130a681c5c41e3ff62c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.399697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0018e890ff4130a681c5c41e3ff62c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.402092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.452002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.453304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.453872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.454370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.455432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.458398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.484303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 933/1862] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:58.487181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.489470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.508588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0018e890ff4130a681c5c41e3ff62c', 'request_id': 'req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:58.523802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0018e890ff4130a681c5c41e3ff62c', 'request_id': 'req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:58.525625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:58.537286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:58.541535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0018e890ff4130a681c5c41e3ff62c', 'request_id': 'req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:58.565591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] The token cache is being invalidate because project 0e0018e890ff4130a681c5c41e3ff62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:23:58.565889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:58.566650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:23:58.568299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 930/1863] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:23:58 2022] DELETE /identity/v3/projects/0e0018e890ff4130a681c5c41e3ff62c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:58.570889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.573864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.585782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05682-939e-4060-8e63-8b760bc685da admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.669064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f08b7c-f4ee-4bfd-a848-ffd4b33300e7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.675552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.676400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.676776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.677148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] PATH_INFO: `/v3/projects/40ff00434a41499fbf8ba957d8fa4425/users/a49fdb6ff80c4d79b168710c4cbf95e5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.679628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff00434a41499fbf8ba957d8fa4425, user_id=a49fdb6ff80c4d79b168710c4cbf95e5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.683168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e2ce-13f0-4edd-bae6-3bd8431e1764 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.695025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:58.695916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.696282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.696710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.699819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 931/1864] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:58 2022] PUT /identity/v3/projects/40ff00434a41499fbf8ba957d8fa4425/users/a49fdb6ff80c4d79b168710c4cbf95e5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:58.701828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d039d-d9bf-4b6b-925b-3bfa9a79c4fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.702349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d039d-d9bf-4b6b-925b-3bfa9a79c4fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.702863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d039d-d9bf-4b6b-925b-3bfa9a79c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.703171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.763523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-226d039d-d9bf-4b6b-925b-3bfa9a79c4fe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:58.769139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-226d039d-d9bf-4b6b-925b-3bfa9a79c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.814093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:58.815116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6744-892d-4e31-bc6b-2e72e531d694 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:58.826354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 934/1865] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:58.827636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.828851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.828851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.868280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] MFA Rules not processed for user `a49fdb6ff80c4d79b168710c4cbf95e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:58.870679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.916905 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 932/1866] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:58.925230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:58.925535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:58.925814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:58.961515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:58.962804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:58.974447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 933/1867] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:58.978056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:58.992874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d503-0cc1-40e3-822d-a5ce8bf5886e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:58.999857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.000558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.000839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.001160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.002903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:23:59.002903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.003806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.033881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 935/1868] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:59.042546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 934/1869] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:23:59.046119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.077137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468faac3-a973-4aae-9c37-90fd3a4cbe47 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.084205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.088697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:59.117635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.123951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.124315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.124602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.125302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.127280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.153960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:59.218591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 936/1870] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:59.235803 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.287365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefdcc6-cfff-4f4c-a6b5-a82659908a00 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.310049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:23:59.422457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf006-1cbe-42f6-957e-7d376f269cdf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.441020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.441852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.442053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.442351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.443003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.445014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.455730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.456392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.456726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.456919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.509585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 937/1871] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:59 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:59.516599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.540815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef823-f3bc-4c6a-bed2-dd553ee08eed admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.554143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.555055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.556630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.556976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.557709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.560792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.576273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 938/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:23:59.580542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.593600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441387-ed4f-45e4-ba07-d071c0b522bc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.599265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.600525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.601255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.602583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.602583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.602840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.602998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.604851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae558a-571e-404a-a21c-9bc4dcd59c85 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.615936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 935/1873] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:23:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:23:59.620645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 939/1874] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:23:59.624947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.636573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc45a0e-7641-430f-8320-eca2dbe7eac5 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.642520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.643833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.644366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.644722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] PATH_INFO: `/v3/projects/ebccaf381cf14481870cdbec0f6a136d/users/cd9dbf4997994fb581b56976740b64c0/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.665760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebccaf381cf14481870cdbec0f6a136d, user_id=cd9dbf4997994fb581b56976740b64c0, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.675718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.691682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 936/1875] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:23:59 2022] PUT /identity/v3/projects/ebccaf381cf14481870cdbec0f6a136d/users/cd9dbf4997994fb581b56976740b64c0/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:23:59.701977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.702268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.702546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.738223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] MFA Rules not processed for user `cd9dbf4997994fb581b56976740b64c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:23:59.739535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:23:59.814289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 940/1876] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:23:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:23:59.818530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.892238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9329-99b4-4170-afb8-fe70bf51b862 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:23:59.897846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:23:59.898563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:23:59.898896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:23:59.899248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:23:59.899940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:23:59.902017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:23:59.936397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 937/1877] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:23:59 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:23:59.940377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:23:59.952843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd4f3-4a21-4966-b187-f33d7940af82 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.005779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:00.016365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.017070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.017295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.017572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.018220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.020302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.042226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 941/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:23:59 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:00.046195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.057076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f042c84-34ab-4820-acb8-ec12b614fa30 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.063404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.066549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.066549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.066549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.066549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.066965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.079244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 938/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:00.082959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.090672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.093816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d70a-8222-417c-b488-3f4080647875 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.098717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.099435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.099720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.100000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] PATH_INFO: `/v3/projects/e6db84a06f674dcea0fad46a252cc48b/users/0abfa28bc5cc43a1881fa9bfdd54b0c3/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.107336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8ca8-4916-44b4-999e-024e1233b835 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.114695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.115753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.116262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.116763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] PATH_INFO: `/v3/users/f4915cf26e61499391ff6854e3382ea6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.117816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6db84a06f674dcea0fad46a252cc48b, user_id=0abfa28bc5cc43a1881fa9bfdd54b0c3, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.118704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4915cf26e61499391ff6854e3382ea6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.121189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.121600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.141579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 942/1880] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:00 2022] PUT /identity/v3/projects/e6db84a06f674dcea0fad46a252cc48b/users/0abfa28bc5cc43a1881fa9bfdd54b0c3/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:00.145936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.166761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:00.266897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246b4c-3687-4ea4-871c-85db6b13d391 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.271806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4915cf26e61499391ff6854e3382ea6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:00.279517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.280183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.280436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.280704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.281370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.283176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.289809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4915cf26e61499391ff6854e3382ea6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:00.299949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 943/1881] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:00.301955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.303454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4915cf26e61499391ff6854e3382ea6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:00.305333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4915cf26e61499391ff6854e3382ea6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:00.307162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf1d47b7-e325-456a-86f8-66f95fdd8e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4915cf26e61499391ff6854e3382ea6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:00.326617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef318df-35d3-48f2-93ab-d374d6e6aa9f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.339190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 939/1882] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:00 2022] DELETE /identity/v3/users/f4915cf26e61499391ff6854e3382ea6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:00.340920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.341208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.341483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.344144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.344849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.345126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.345403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] PATH_INFO: `/v3/projects/e6db84a06f674dcea0fad46a252cc48b/users/0abfa28bc5cc43a1881fa9bfdd54b0c3/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.347677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6db84a06f674dcea0fad46a252cc48b, user_id=0abfa28bc5cc43a1881fa9bfdd54b0c3, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.351013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c3d2-36da-4dcb-858c-b3630320d074 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.365842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 944/1883] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:00 2022] PUT /identity/v3/projects/e6db84a06f674dcea0fad46a252cc48b/users/0abfa28bc5cc43a1881fa9bfdd54b0c3/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:00.378258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.378543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.378821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.400321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:00.401923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:00.415413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] MFA Rules not processed for user `0abfa28bc5cc43a1881fa9bfdd54b0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:00.417112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:00.555310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 940/1884] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:00.568436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 945/1885] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:00.584153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.585592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:00.628034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.629968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:00.686270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e6e77-500a-46d8-a8d4-cb7a7ca29674 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.691191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:00.700434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.701091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.701367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.701807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.722356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.724738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.749550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 941/1886] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:00.750951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1d42c-86cd-450f-8a96-cd7221c8b097 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.754838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.755498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.755778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.756197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.768583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:00.770222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:00.782949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 946/1887] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:00.814254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:00.835502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6595f71-71b1-4dc5-be05-daa0e8938da4 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:00.851690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:00.852492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:00.856243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:00.857838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:00.866255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:00.925421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:01.016246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:01.021214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b01d8-cb7a-4332-8143-d53646f5c3d6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:01.057170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 942/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:01.106500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:01.108430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:01.131958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ceeff-360f-46df-a085-877adb744fa6 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:01.141507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:01.142152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.142434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.142715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.151095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:01.294713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:01.296274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8952042-180a-4c12-89a7-2d52b39fc377 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:01.316147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 947/1889] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:01.357729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.358054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.358414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.360139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 943/1890] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:24:01.380500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.380861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.381120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.426525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:01.426728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:01.527896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 948/1891] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:24:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:01.549777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:01.551624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:01.588514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c3bf-2341-4d37-8944-9c5a2bca1585 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:01.600746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:01.601367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.601694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.601965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.619778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:01.621568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:01.633747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 944/1892] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:01.645393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:01.647010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:01.664611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f29269-06ac-4d31-9f62-4d0cb84c94a1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:01.676134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:01.676994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.677589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.677871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] PATH_INFO: `/v3/projects/9984ab55be3744eb8983d1def2a1744b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.679075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9984ab55be3744eb8983d1def2a1744b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:01.681425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:01.764922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9984ab55be3744eb8983d1def2a1744b', 'request_id': 'req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:01.772964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:01.783140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9984ab55be3744eb8983d1def2a1744b', 'request_id': 'req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:01.794343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9984ab55be3744eb8983d1def2a1744b', 'request_id': 'req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:01.809163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] The token cache is being invalidate because project 9984ab55be3744eb8983d1def2a1744b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:01.809746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:01.811443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:01.813850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 949/1893] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:01 2022] DELETE /identity/v3/projects/9984ab55be3744eb8983d1def2a1744b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:01.817930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:01.830693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadf84-8293-4f18-b792-d9a031f04ad7 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:01.939060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:01.939919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:01.940264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:01.940561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] PATH_INFO: `/v3/users/a49fdb6ff80c4d79b168710c4cbf95e5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:01.942000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49fdb6ff80c4d79b168710c4cbf95e5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:01.945642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:02.037754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49fdb6ff80c4d79b168710c4cbf95e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.055540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49fdb6ff80c4d79b168710c4cbf95e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.065426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49fdb6ff80c4d79b168710c4cbf95e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.066101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49fdb6ff80c4d79b168710c4cbf95e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.066735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-292cd9bf-3274-414b-b647-e9d08de280ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49fdb6ff80c4d79b168710c4cbf95e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.095933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 945/1894] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:01 2022] DELETE /identity/v3/users/a49fdb6ff80c4d79b168710c4cbf95e5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:02.429800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:02.431637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:02.452624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44d7c-d6d2-4578-8fc2-827b13b21b36 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:02.556829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:02.558864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:02.559491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:02.559635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] PATH_INFO: `/v3/projects/40ff00434a41499fbf8ba957d8fa4425` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:02.563650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ff00434a41499fbf8ba957d8fa4425)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:02.566341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:02.672829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ff00434a41499fbf8ba957d8fa4425', 'request_id': 'req-1e3acb78-2041-41c1-a553-b70b53d3d542'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.685514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ff00434a41499fbf8ba957d8fa4425', 'request_id': 'req-1e3acb78-2041-41c1-a553-b70b53d3d542'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.697126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ff00434a41499fbf8ba957d8fa4425', 'request_id': 'req-1e3acb78-2041-41c1-a553-b70b53d3d542'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.736234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] The token cache is being invalidate because project 40ff00434a41499fbf8ba957d8fa4425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:02.736539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.743479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1e3acb78-2041-41c1-a553-b70b53d3d542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:02.752894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 950/1895] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:02 2022] DELETE /identity/v3/projects/40ff00434a41499fbf8ba957d8fa4425 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:02.755249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:02.756088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:02.756561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:02.782131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:02.783975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:02.812388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:02.865678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 946/1896] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:02.876111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:02.876398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:02.876674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:02.899243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:02.900558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:02.910415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 951/1897] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:02.915486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:02.926851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebfde-7491-47f2-8caf-b04a1bf361da None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:02.932109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:02.932758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:02.933033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:02.933365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:02.934019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:02.934312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:02.935963 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:02.949045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 947/1898] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:02.953876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:02.963593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b456-3c13-49a2-bdd8-93ad63f33292 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:02.969340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:02.969961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:02.970240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:02.970507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:02.971223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:02.973162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.010039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 952/1899] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:02 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:03.011225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.025405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c5457-8e2b-4f07-bae0-970e6e7b1bda admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.140109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.140847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.141229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.141687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.142546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.147794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.203116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 948/1900] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:03 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:03.204516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.217764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b0e9-b25a-473b-874e-ec3f188e530a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.230614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.231416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.231895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.232183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.232835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.234487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.251964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 953/1901] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:03.253403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.265209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a81-f292-4502-b04c-a97a2fa35b36 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.271388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.272249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.272510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.272782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.273478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.275105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88837d42-127a-4a48-9aaf-1bcfa92fa3c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.291066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 949/1902] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:03.293692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.304402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95977-d191-4051-be41-8cfd7b9da0cd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.309248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.310083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.310378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.310712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] PATH_INFO: `/v3/projects/e70cae8677df435383d62db9d9057c09/users/d07d134e15ba48a29e343e890e473572/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.347566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70cae8677df435383d62db9d9057c09, user_id=d07d134e15ba48a29e343e890e473572, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.351187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.377721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 954/1903] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:03 2022] PUT /identity/v3/projects/e70cae8677df435383d62db9d9057c09/users/d07d134e15ba48a29e343e890e473572/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:03.389049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.389446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.389988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.431724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] MFA Rules not processed for user `d07d134e15ba48a29e343e890e473572`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:03.433685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:03.538616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 950/1904] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:03.543854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.556456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:03.621831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3640d-8475-4151-ac1f-d67542f9ae16 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.626943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.627748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.628093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.628435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.629155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.631143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.660523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 955/1905] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:03.664604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.675488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d69c-17df-4a5b-8712-b89f268ad87f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.701860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:03.762933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.763955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.765096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.765470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.766720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.769317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.818503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 951/1906] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:03 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:03.822371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.834812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7b9b3-8b97-4f9b-8327-b7e43c49ca8b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.843682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.844642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.845069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.845500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.846363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.849120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.863496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 956/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:03.867837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.880061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e76e-a34c-4726-befa-d90d49d5ce60 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.884994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.885763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.886126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.886830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.887363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.889511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42995a-b91e-4225-9023-4aebd7661bab admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:03.903255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 952/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:03.905411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:03.937076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e6fe-5285-4bb9-b9b2-6a10486334c9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:03.950551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:03.952244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:03.954252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:03.954645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] PATH_INFO: `/v3/projects/ee559d5ad8d445ce81907f74f59ac4d3/users/4d8217d328324b2c8fb08427d660b7ed/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:03.975965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee559d5ad8d445ce81907f74f59ac4d3, user_id=4d8217d328324b2c8fb08427d660b7ed, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:03.979398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.011302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 957/1909] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:03 2022] PUT /identity/v3/projects/ee559d5ad8d445ce81907f74f59ac4d3/users/4d8217d328324b2c8fb08427d660b7ed/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:04.017595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.018065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.018548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.072601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] MFA Rules not processed for user `4d8217d328324b2c8fb08427d660b7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:04.074007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:04.154932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 953/1910] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:04.159533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.241594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42776-a016-4d16-a7c6-2e52aaab27d2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.247458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.248083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.248366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.248642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.249289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.251251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.282950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 958/1911] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:04 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:04.287114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.302511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac922-0a2e-4747-a801-7a27fc397788 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.367987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.368705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.369387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.369728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.370430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.373050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.397681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 954/1912] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:04 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:04.402575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.413341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714deab4-00b7-4b5f-a2a2-959b5c49d493 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.420128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.420894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.421622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.421622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.422157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.423807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.439608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 959/1913] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:04.443628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.454906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52668-52d8-471c-ab69-38ad6ea103bf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.461095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.463082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.463082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.463082 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] PATH_INFO: `/v3/projects/b4f0222eefe84dd49fe341973685bf5a/users/8a9010855b6b4d6fa672cb8033038d60/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.503191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f0222eefe84dd49fe341973685bf5a, user_id=8a9010855b6b4d6fa672cb8033038d60, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.506429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.521574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:04.533399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 955/1914] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:04 2022] PUT /identity/v3/projects/b4f0222eefe84dd49fe341973685bf5a/users/8a9010855b6b4d6fa672cb8033038d60/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:04.537402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.551459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbf83-56d1-4220-b618-2c02c3297d51 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.622495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:04.707662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.709362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.709651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.711784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.715902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.720016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f5da1-ed4f-4949-985a-a19f4a394e51 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.754999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 960/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:04.759117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:04.774070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23b91-2155-4c0f-8c95-21ea528d1f4a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:04.802143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:04.803770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.805378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.805910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] PATH_INFO: `/v3/projects/b4f0222eefe84dd49fe341973685bf5a/users/8a9010855b6b4d6fa672cb8033038d60/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.812710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f0222eefe84dd49fe341973685bf5a, user_id=8a9010855b6b4d6fa672cb8033038d60, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:04.816036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:04.853832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 956/1916] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:04 2022] PUT /identity/v3/projects/b4f0222eefe84dd49fe341973685bf5a/users/8a9010855b6b4d6fa672cb8033038d60/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:04.867461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:04.867755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:04.868029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:04.936350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] MFA Rules not processed for user `8a9010855b6b4d6fa672cb8033038d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:04.936350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:05.113795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 961/1917] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:05.245121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:05.247434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:05.320467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8560b-6033-4a7b-9c5b-69de39665644 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:05.326340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:05.327341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:05.327655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:05.328348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:05.408274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:05.409985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcbcf6-00aa-4340-a2f9-ad9f2d03915a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:05.421632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 957/1918] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:05.635326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:05.636859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:05.798409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5f9c6-45f9-42f5-a214-579c6919dd18 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:05.812839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:05.813896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:05.814311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:05.814748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] PATH_INFO: `/v3/users/970efea033794da7b7aa83c918af4976` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:05.820298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970efea033794da7b7aa83c918af4976)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:05.835409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:05.908177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970efea033794da7b7aa83c918af4976'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:05.922222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970efea033794da7b7aa83c918af4976'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:05.927301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:05.940256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970efea033794da7b7aa83c918af4976'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:05.941517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970efea033794da7b7aa83c918af4976'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:05.967711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970efea033794da7b7aa83c918af4976'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:05.980561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 962/1919] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:05 2022] DELETE /identity/v3/users/970efea033794da7b7aa83c918af4976 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:05.985572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:05.986100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:05.986239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:06.011212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:06.012584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:06.083527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 958/1920] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:06.093197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:06.094913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:06.158469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3bb14-2bda-4c00-98aa-56bafbaf17b2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:06.162301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:06.162945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:06.163250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:06.163523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:06.172894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:06.174318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:06.184865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 963/1921] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:06.505233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:06.506685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:06.534116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96846-4248-4d3b-b78b-8f4d2c57bce1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:06.540542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:06.541232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:06.541511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:06.541792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] PATH_INFO: `/v3/projects/91938bc6805748139ff83fef403342da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:06.543340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91938bc6805748139ff83fef403342da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:06.545395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:06.603732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:06.637640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91938bc6805748139ff83fef403342da', 'request_id': 'req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.655741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91938bc6805748139ff83fef403342da', 'request_id': 'req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.670609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91938bc6805748139ff83fef403342da', 'request_id': 'req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.697923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] The token cache is being invalidate because project 91938bc6805748139ff83fef403342da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:06.697923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.698768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.701701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 959/1922] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:06 2022] DELETE /identity/v3/projects/91938bc6805748139ff83fef403342da => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:06.705511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:06.717885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f012a-9dc6-45b3-adea-cbbc4d960cd1 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:06.788937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:06.789594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:06.789955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:06.791600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] PATH_INFO: `/v3/users/ae20210947fb464e86d4cb807e0e3cae` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:06.793135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae20210947fb464e86d4cb807e0e3cae)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:06.795425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:06.863831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae20210947fb464e86d4cb807e0e3cae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.878396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae20210947fb464e86d4cb807e0e3cae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.889362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae20210947fb464e86d4cb807e0e3cae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.890080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae20210947fb464e86d4cb807e0e3cae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.902412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:06.904288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae20210947fb464e86d4cb807e0e3cae'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:06.913709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 964/1923] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:06 2022] DELETE /identity/v3/users/ae20210947fb464e86d4cb807e0e3cae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:07.093697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.095162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:07.177718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3913-0674-40ce-95c2-a0dc0ddce94b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.229898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.233899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:07.258147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.259166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.259553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.259804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.262053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:07.345658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.355538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc47f0f-e8d6-4956-a1fb-b12711589e72 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.355728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fd694-579d-4a40-ac27-5c0433d73b73 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.363901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.364892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.365280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.365665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] PATH_INFO: `/v3/projects/2a43e6cc596d45a6b07a13829e6399df` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.367488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a43e6cc596d45a6b07a13829e6399df)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.370479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.370802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 960/1924] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:07.451315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a43e6cc596d45a6b07a13829e6399df', 'request_id': 'req-36ddee59-ce68-44b2-a62e-e11a72ffd20c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:07.473470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a43e6cc596d45a6b07a13829e6399df', 'request_id': 'req-36ddee59-ce68-44b2-a62e-e11a72ffd20c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:07.481314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a43e6cc596d45a6b07a13829e6399df', 'request_id': 'req-36ddee59-ce68-44b2-a62e-e11a72ffd20c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:07.498201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] The token cache is being invalidate because project 2a43e6cc596d45a6b07a13829e6399df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:07.498754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:07.500044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-36ddee59-ce68-44b2-a62e-e11a72ffd20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:07.502669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 965/1925] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:07 2022] DELETE /identity/v3/projects/2a43e6cc596d45a6b07a13829e6399df => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:07.508637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.508921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.509240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.536557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:07.537928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:07.578546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:07.616972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 961/1926] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:07.628063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.628380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.628637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.650158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:07.651427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:07.663501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 966/1927] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:07.665032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.676365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf7ee3-7219-430c-bce4-289cfeede579 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.680978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.682234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.682514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.682858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.683654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:07.683955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.685765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.702882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 962/1928] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:07.705684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.717827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25c3f-1034-4c63-b80f-849bb6dab9be None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.724372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.725306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.725726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.726000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.726655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.728667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.767248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 967/1929] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:07 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:07.769090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.780342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12ebcc-0d8e-4428-9d1d-8ea1f76fed18 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.856430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.857673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.857673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.857673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.858247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.862349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.903605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 963/1930] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:07 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:07.916388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.933352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1d2a4-e512-4233-9966-a7fe9c415338 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.946823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:07.947060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:07.947477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:07.947749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:07.948422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:07.952171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:07.976677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 968/1931] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:07.980076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:07.992193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8343-e7c6-4d85-bce0-f9af5b874f00 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:07.997980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.001240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.009588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.010102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.010907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.013152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.039645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.041947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.058996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 964/1932] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:08.062251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.065080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023184-61c0-47e8-bf4a-e416515d483b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.073450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c669-0b51-4a5f-9d5b-8bed6e88f8eb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.073544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.074021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.075305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.075591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] PATH_INFO: `/v3/users/29bbba3f02374fac884e3fca3faad152` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.078624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bbba3f02374fac884e3fca3faad152)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.079906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.080697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.081057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.081399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] PATH_INFO: `/v3/projects/c6d450e147c14e0ca89f01e35653302f/users/5845f117fc324567aa333463861752b0/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.083484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.098185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d450e147c14e0ca89f01e35653302f, user_id=5845f117fc324567aa333463861752b0, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.101262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6e21f-fa61-44c4-9db6-8aaf97d104d3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.123624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 965/1933] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:08 2022] PUT /identity/v3/projects/c6d450e147c14e0ca89f01e35653302f/users/5845f117fc324567aa333463861752b0/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:08.134355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb04f4f-0042-497f-b6ef-06e2bfae9353 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.134637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb04f4f-0042-497f-b6ef-06e2bfae9353 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.134908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb04f4f-0042-497f-b6ef-06e2bfae9353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.159536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:08.165909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bbba3f02374fac884e3fca3faad152'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:08.173658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-adb04f4f-0042-497f-b6ef-06e2bfae9353 None None] MFA Rules not processed for user `5845f117fc324567aa333463861752b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:08.174876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-adb04f4f-0042-497f-b6ef-06e2bfae9353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.175658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bbba3f02374fac884e3fca3faad152'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:08.185055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bbba3f02374fac884e3fca3faad152'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:08.186655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bbba3f02374fac884e3fca3faad152'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:08.203228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bbba3f02374fac884e3fca3faad152'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:08.209685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 969/1934] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:08 2022] DELETE /identity/v3/users/29bbba3f02374fac884e3fca3faad152 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:08.210631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.211820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.251218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 966/1935] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:08.252495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.252778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.253189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.261189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:08.275214 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:08.276438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.286316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d583-4d06-4a9f-abdd-4dfa670e8109 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.295560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.295560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.295560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.295560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.295923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.346970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 967/1936] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:08.348126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.351152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.379417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a3e1-21d3-4941-9e10-5f75c08b4778 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.385421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.386060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.386827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.387103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.387468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.387706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.388160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.390372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.408700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 970/1937] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:08.409663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.411710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.453664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 968/1938] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:08 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:08.458044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.520204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e5f7e-f5d9-4d93-9d90-8b16ff453cbc service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.579536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:08.611716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f7e7-ca1b-4031-b37a-a39b77c1c876 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.620283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.633407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.634054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.634593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.642865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.654893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.666313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.666942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.667230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.667556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.681105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.683001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.700655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 969/1939] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:08 2022] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:08.705316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.715795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 971/1940] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:08.721523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513824-6142-4d05-a3a1-70533616f32f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.726782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.727601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.727972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.728336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.729081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.731025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.744135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 970/1941] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:08.749119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.764166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab0c30-7e6c-47cf-99da-c952dc57bd37 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.778104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.779230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.779660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.780260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] PATH_INFO: `/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995/users/f39e9419461e48b5b5642d812c33eee6/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.801869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ec6877ea7644e4ad8d5b322d14d995, user_id=f39e9419461e48b5b5642d812c33eee6, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.812480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.828720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.830310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:08.838798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 972/1942] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:08 2022] PUT /identity/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995/users/f39e9419461e48b5b5642d812c33eee6/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:08.844527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.846526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381716e8-1ab9-4538-a8b1-67eed33ecfcc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.931595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458a970-bf55-4e22-bd7a-3e057b713de1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.934613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.937359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.937359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.937566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] PATH_INFO: `/v3/users/cd9dbf4997994fb581b56976740b64c0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.947232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:08.947232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:08.947232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:08.947232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:08.948167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.948388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9dbf4997994fb581b56976740b64c0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:08.948470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.948540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:08.958499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:08.959119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 973/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:08.960434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:08.983581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedcfc5-a607-4cc9-9a8a-648994f1122d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:08.995478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:09.000565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.001122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.001691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] PATH_INFO: `/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995/users/f39e9419461e48b5b5642d812c33eee6/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.011863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ec6877ea7644e4ad8d5b322d14d995, user_id=f39e9419461e48b5b5642d812c33eee6, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:09.024719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2dde6-ae5f-4624-9895-f9f041ae81a8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:09.049543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 974/1944] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:08 2022] PUT /identity/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995/users/f39e9419461e48b5b5642d812c33eee6/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:09.058000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9dbf4997994fb581b56976740b64c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:09.063346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.063861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.064344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.086713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9dbf4997994fb581b56976740b64c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:09.095689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9dbf4997994fb581b56976740b64c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:09.096450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9dbf4997994fb581b56976740b64c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:09.097142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6b67559b-dca8-460b-82bb-460dc0bdd885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9dbf4997994fb581b56976740b64c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:09.111950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] MFA Rules not processed for user `f39e9419461e48b5b5642d812c33eee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:09.113873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.119571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 971/1945] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:08 2022] DELETE /identity/v3/users/cd9dbf4997994fb581b56976740b64c0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:09.123784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.124200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.124567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.157908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:09.159530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.246473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 975/1946] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:09.254166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:09.255903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.264347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 972/1947] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:09.274761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:09.334999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330905f-0fb7-4de5-a7d8-b7ff3110b014 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:09.345287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:09.349517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.413360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:09.414268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.414852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.415338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.459836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94938197-fa1f-4355-beee-9913d8bfa0e7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:09.472930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:09.475024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.475514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.476995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.491403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:09.493714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:09.511744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:09.512238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 973/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:09.515015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:09.528401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 976/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:09.577907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:09.579494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.593130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c101aa0-27ce-4081-8727-2444b769d211 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:09.596944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:09.598789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:09.598789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:09.598789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:09.600158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:09.626724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:09.703162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:09.707790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec235f5f-eb23-44fa-9fb4-7ad8094aa004 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:09.720276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 974/1950] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:10.590893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:10.592447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:10.606862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350c820-6dbd-48ee-8761-fd25d22304dc service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:10.612019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:10.612682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:10.612977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:10.613269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] PATH_INFO: `/v3/projects/d082e8cfcf3949b0b7490427dbbd72cb` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:10.614513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d082e8cfcf3949b0b7490427dbbd72cb)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:10.616557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:10.696324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd082e8cfcf3949b0b7490427dbbd72cb', 'request_id': 'req-0c87dd25-34e1-4b82-92d0-5a13256da42a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:10.707612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd082e8cfcf3949b0b7490427dbbd72cb', 'request_id': 'req-0c87dd25-34e1-4b82-92d0-5a13256da42a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:10.720165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd082e8cfcf3949b0b7490427dbbd72cb', 'request_id': 'req-0c87dd25-34e1-4b82-92d0-5a13256da42a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:10.731287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:10.742816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] The token cache is being invalidate because project d082e8cfcf3949b0b7490427dbbd72cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:10.743151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:10.746644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0c87dd25-34e1-4b82-92d0-5a13256da42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:10.748420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 977/1951] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:10 2022] DELETE /identity/v3/projects/d082e8cfcf3949b0b7490427dbbd72cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:10.753635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:10.754611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:10.755134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:10.792819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:10.794725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:10.936630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 975/1952] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:10.944879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:10.945167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:10.945437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:10.989739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:10.991411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:11.004491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 978/1953] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:11.007036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.009194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:11.018168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.025732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105f2d-89f4-42bd-8998-d156509ef30b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.036736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.037404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.037685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.037958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] PATH_INFO: `/v3/projects/ebccaf381cf14481870cdbec0f6a136d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.039056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00783db2-ade9-4ffb-9ff9-5846f64c9474 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.040565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebccaf381cf14481870cdbec0f6a136d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.042741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.045409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.046465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.046856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.047219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.048051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:11.048457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.050911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.078848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 979/1954] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:11.084440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.098446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44f7e-312b-4a2f-b6be-b3d8127c0205 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.123794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebccaf381cf14481870cdbec0f6a136d', 'request_id': 'req-faff37e3-524a-43a8-9cfd-191557942041'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.131989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebccaf381cf14481870cdbec0f6a136d', 'request_id': 'req-faff37e3-524a-43a8-9cfd-191557942041'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.142091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebccaf381cf14481870cdbec0f6a136d', 'request_id': 'req-faff37e3-524a-43a8-9cfd-191557942041'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.167156 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] The token cache is being invalidate because project ebccaf381cf14481870cdbec0f6a136d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:11.168051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.170804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.171722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 976/1955] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:11 2022] DELETE /identity/v3/projects/ebccaf381cf14481870cdbec0f6a136d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:11.177227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.179598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:11.182009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.182636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.182964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.183550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.184226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.186155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.225124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 980/1956] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:11.230227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff37e3-524a-43a8-9cfd-191557942041 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.239084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.242426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:11.349152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:11.393302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.394595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.395097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.395633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] PATH_INFO: `/v3/users/0abfa28bc5cc43a1881fa9bfdd54b0c3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.397965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abfa28bc5cc43a1881fa9bfdd54b0c3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.400693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.418549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95b63-3c47-4b1e-bc1b-1ab5681b5a48 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.454050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.455155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.455765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.456493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.457454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.475392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.511528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abfa28bc5cc43a1881fa9bfdd54b0c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.530883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 981/1957] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:11 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:11.532119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.540884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abfa28bc5cc43a1881fa9bfdd54b0c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.557788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abfa28bc5cc43a1881fa9bfdd54b0c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.559545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abfa28bc5cc43a1881fa9bfdd54b0c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.561540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abfa28bc5cc43a1881fa9bfdd54b0c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:11.597233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 977/1958] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:11 2022] DELETE /identity/v3/users/0abfa28bc5cc43a1881fa9bfdd54b0c3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:11.600732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2caa4e-e19f-422f-8336-65279bff7095 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.795805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:11.818973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.818973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.819336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.819562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.820218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.827008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.853559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 982/1959] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:11.854392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.856814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:11.884424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2837-1c70-442e-b70e-843fc4ba9c16 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.898187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.898808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.899085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.899406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:11.900194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:11.902068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d96d5a-4ac1-4023-b994-b2c014da911a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:11.929192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 978/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:11.929760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:11.950523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bab3d-98ed-4544-a12f-78e7b429ed87 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:11.967486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:11.968843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:11.969887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:11.970825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] PATH_INFO: `/v3/projects/5f5888dc5c5c4c788608d34863c24d15/users/20309a1280c443418b493ed4f11224f5/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:12.040874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5888dc5c5c4c788608d34863c24d15, user_id=20309a1280c443418b493ed4f11224f5, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:12.052296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:12.096743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 983/1961] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:11 2022] PUT /identity/v3/projects/5f5888dc5c5c4c788608d34863c24d15/users/20309a1280c443418b493ed4f11224f5/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:12.107383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:12.107923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:12.108340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:12.184264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] MFA Rules not processed for user `20309a1280c443418b493ed4f11224f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:12.185461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:12.339310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 979/1962] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:12.352244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:12.354784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:12.554579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b758-04df-4dd0-acbd-1a570d51858e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:12.569014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:12.569720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:12.569929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:12.570207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:12.582316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:12.583829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:12.608067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 984/1963] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:12.637871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:12.766915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:12.808716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e46140-ccc0-40f0-99f0-b245cb9ac3dd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:12.813997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:12.815234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:12.815234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:12.815234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] PATH_INFO: `/v3/users/20309a1280c443418b493ed4f11224f5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:12.816471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=20309a1280c443418b493ed4f11224f5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:12.818422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:12.915160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20309a1280c443418b493ed4f11224f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:12.942259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20309a1280c443418b493ed4f11224f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:12.954922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20309a1280c443418b493ed4f11224f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:12.955069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20309a1280c443418b493ed4f11224f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:12.956778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:12.958038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-06decc79-1a02-46fc-b5fe-19cc3737b3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20309a1280c443418b493ed4f11224f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:12.958771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:12.980528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 980/1964] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:12 2022] DELETE /identity/v3/users/20309a1280c443418b493ed4f11224f5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:12.987680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:12.987996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:12.988234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:12.991555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d728a-d936-4ffa-85e0-8d3176580440 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.028502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:13.029748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.150870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.151922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.152268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.152599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] PATH_INFO: `/v3/projects/e6db84a06f674dcea0fad46a252cc48b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.154091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6db84a06f674dcea0fad46a252cc48b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.157040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.159015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 981/1965] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:13.180343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.182140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.270617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6db84a06f674dcea0fad46a252cc48b', 'request_id': 'req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.304470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6db84a06f674dcea0fad46a252cc48b', 'request_id': 'req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.304671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6db84a06f674dcea0fad46a252cc48b', 'request_id': 'req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.321956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:13.326181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829170-6467-45e6-8640-7759bbaf4ac7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.329082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] The token cache is being invalidate because project e6db84a06f674dcea0fad46a252cc48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:13.330270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.331448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1f906bcc-f6a1-48e7-8afe-3b66ea8fa14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.338221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 985/1966] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:12 2022] DELETE /identity/v3/projects/e6db84a06f674dcea0fad46a252cc48b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:13.340522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.341307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.341808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.378030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:13.378502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.387719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:13.442688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.443359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.443801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.444078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.446364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.484716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 986/1967] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:13.485978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.487555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.508075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364bd63-5741-4798-a4ee-bba4a4c2ce50 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.524992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.526259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.527742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.527742 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] PATH_INFO: `/v3/users/d07d134e15ba48a29e343e890e473572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.529324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07d134e15ba48a29e343e890e473572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.535280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.554158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.556820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53e642-bc2a-4720-ba82-8eb0f1ad1414 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.570900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 982/1968] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:13.595807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.595807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.595807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.599757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07d134e15ba48a29e343e890e473572'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.609335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07d134e15ba48a29e343e890e473572'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.618208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07d134e15ba48a29e343e890e473572'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.619545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07d134e15ba48a29e343e890e473572'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.626018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:13.627502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.633982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43667ef2-07ea-4673-95e2-ffb94497c366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07d134e15ba48a29e343e890e473572'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:13.642030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 987/1969] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:13 2022] DELETE /identity/v3/users/d07d134e15ba48a29e343e890e473572 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:13.642829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 983/1970] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:13.647668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.648025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.648391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.650954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.664480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa039cf-ebee-4360-96be-35c6160bf282 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.675407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:13.676553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.757174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 988/1971] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:13.758571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.759312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.759654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.759992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.760847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:13.761459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.764653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.768288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.770380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.785630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 984/1972] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:13.788367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.799648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e85a0d-2aad-48a5-8fad-0c9a11cf7233 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.802656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:13.806624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.807290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.807590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.807857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.808516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.810492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.847926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 985/1973] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:13 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:13.848888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.862883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845185f-089a-4cef-8ce6-0cead98b7a55 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.900143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:13.937459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.938144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.938446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.938699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.942492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b710-898e-4bc0-9e93-4f0dbddf8be0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.947786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:13.948514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:13.948927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:13.949187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:13.949835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.951846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.954302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:13.955804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:13.966911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 989/1974] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:13.967798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.969278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:13.986932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 986/1975] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:13 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:13.992772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c594-9812-4abb-b418-e095d4b410bf service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:13.993232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:13.999878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.001206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.001587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.001951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] PATH_INFO: `/v3/projects/5f5888dc5c5c4c788608d34863c24d15` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.003388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5888dc5c5c4c788608d34863c24d15)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.004660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2bc88-a8cf-46e6-99c1-0ad039f643b2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.005602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.010401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.011027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.011403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.011685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.012373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.014702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.030814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 987/1976] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:14.035759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.049607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5e876-1534-4d5f-b151-1ba8e9daa7cc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.056462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.057394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.057885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.059092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.059767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.061389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.080850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 988/1977] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:14.083485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.086238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5888dc5c5c4c788608d34863c24d15', 'request_id': 'req-10ac635f-a572-48bb-9016-4d0af12dc913'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.097786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e17be-0d32-4336-a916-4d7380394fcb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.098594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5888dc5c5c4c788608d34863c24d15', 'request_id': 'req-10ac635f-a572-48bb-9016-4d0af12dc913'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.106804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5888dc5c5c4c788608d34863c24d15', 'request_id': 'req-10ac635f-a572-48bb-9016-4d0af12dc913'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.120590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] The token cache is being invalidate because project 5f5888dc5c5c4c788608d34863c24d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:14.121336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.122193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-10ac635f-a572-48bb-9016-4d0af12dc913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.127263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 990/1978] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:13 2022] DELETE /identity/v3/projects/5f5888dc5c5c4c788608d34863c24d15 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:14.128763 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8412e8-d406-4bf6-941d-31e079a01c12 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.129584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8412e8-d406-4bf6-941d-31e079a01c12 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.129870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8412e8-d406-4bf6-941d-31e079a01c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.159361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3d8412e8-d406-4bf6-941d-31e079a01c12 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:14.161422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3d8412e8-d406-4bf6-941d-31e079a01c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.187837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.188519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.188873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.189155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] PATH_INFO: `/v3/projects/adde9e0b500946ac8351f611a78dacb5/users/0a5223725cd04611a28226602dc1919a/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.208469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adde9e0b500946ac8351f611a78dacb5, user_id=0a5223725cd04611a28226602dc1919a, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.211569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d2591-d0c8-46c6-8006-cae283775780 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.241785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 989/1979] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:14 2022] PUT /identity/v3/projects/adde9e0b500946ac8351f611a78dacb5/users/0a5223725cd04611a28226602dc1919a/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:14.241986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:14.244804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.245491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.246075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.251518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 991/1980] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:14.258871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.259331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.259607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.279175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] MFA Rules not processed for user `0a5223725cd04611a28226602dc1919a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:14.280493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.289951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:14.293334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.389839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 992/1981] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:14.390862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.401008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.421883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e02cc-82f1-44a2-ac3e-1de65f39c505 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.424811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 990/1982] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:14.425750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.427307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.428053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.428425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.428786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] PATH_INFO: `/v3/projects/e70cae8677df435383d62db9d9057c09` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.430102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70cae8677df435383d62db9d9057c09)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.432756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.447544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f0813-7464-4637-9fcb-71e6604f75b9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.456401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.457024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.457295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.457560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.458271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:14.458557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.474325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.515420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 991/1983] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:14.515420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.518089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.534573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:14.540216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70cae8677df435383d62db9d9057c09', 'request_id': 'req-25f59023-f0f9-44bf-8d42-07f28c434285'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.545107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b959f9-25cd-432f-a1e1-846d229d92a0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.564329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70cae8677df435383d62db9d9057c09', 'request_id': 'req-25f59023-f0f9-44bf-8d42-07f28c434285'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.584385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70cae8677df435383d62db9d9057c09', 'request_id': 'req-25f59023-f0f9-44bf-8d42-07f28c434285'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.614180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] The token cache is being invalidate because project e70cae8677df435383d62db9d9057c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:14.615937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.616763 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:14.620248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 993/1984] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:14 2022] DELETE /identity/v3/projects/e70cae8677df435383d62db9d9057c09 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:14.621530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.625479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.728662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.729659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.730205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.730755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.731666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.733945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.761008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f59023-f0f9-44bf-8d42-07f28c434285 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.768257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.768977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.769273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.769533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.770187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.774152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.775872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 992/1985] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/projects => generated 367 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:14.777226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.780239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.836806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 994/1986] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:14.843585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:14.847238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:14.867414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:14.884166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387847c-6eb2-4204-9097-684b49a629d0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.974199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.974820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce7bb5-905f-42c8-b9f5-548cbca8ea29 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:14.975028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.975262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.975749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] PATH_INFO: `/v3/users/4d8217d328324b2c8fb08427d660b7ed` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.977064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8217d328324b2c8fb08427d660b7ed)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.979183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:14.980788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:14.981444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:14.981866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:14.982391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:14.982951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:14.985060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.014101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 995/1987] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:14 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:15.017231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.025394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:15.028868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffcf1-476e-4160-bf02-64e535a94ac2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.034420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.035045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.035397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.035678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.035964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8217d328324b2c8fb08427d660b7ed'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.036347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.038757 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.053857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8217d328324b2c8fb08427d660b7ed'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.062117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8217d328324b2c8fb08427d660b7ed'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.062860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8217d328324b2c8fb08427d660b7ed'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.063594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8217d328324b2c8fb08427d660b7ed'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.064087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 996/1988] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:15 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:15.065160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.067007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.081093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 993/1989] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:14 2022] DELETE /identity/v3/users/4d8217d328324b2c8fb08427d660b7ed => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.081925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.082288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba3e07-636d-468e-95b9-45d8b985221d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.083434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.170787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.171567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.171957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.172324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] PATH_INFO: `/v3/users/5845f117fc324567aa333463861752b0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.174098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5845f117fc324567aa333463861752b0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.176390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.178751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331fe14-02f0-4b89-957c-10ea6bc030f7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.184757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.185830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.186161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.186489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.187313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.189002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.205706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 994/1990] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:15.206679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.208456 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.221530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de22c-4ff3-4b8e-a3e4-8dc3c382e783 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.227238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.227980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.228303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.228566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.229715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.231573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.251461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 995/1991] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:15.251945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5845f117fc324567aa333463861752b0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.253058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.270675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285b3a8-3c20-4936-bb13-c35418cdc958 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.275623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5845f117fc324567aa333463861752b0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.276768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.278008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.278293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.278566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] PATH_INFO: `/v3/projects/20f68ed9be47485eb826d6bb1477c942/users/a05cc14cab8c434bbeb5262b4b55ff28/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.291064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5845f117fc324567aa333463861752b0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.293292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5845f117fc324567aa333463861752b0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.296894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f68ed9be47485eb826d6bb1477c942, user_id=a05cc14cab8c434bbeb5262b4b55ff28, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.300175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.309923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:15.311727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5845f117fc324567aa333463861752b0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.320962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 996/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:15 2022] PUT /identity/v3/projects/20f68ed9be47485eb826d6bb1477c942/users/a05cc14cab8c434bbeb5262b4b55ff28/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.322596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.325380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 997/1993] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:15 2022] DELETE /identity/v3/users/5845f117fc324567aa333463861752b0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.326500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.329489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.330321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.417119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12bad-a04d-4631-81f8-a494048ab206 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.423464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.424486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.424670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.424929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.425525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.425651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbb1c-751c-4761-8dae-b2c12bfd0946 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.427246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98226e4-6c32-4f92-b4ac-745474fa4ab6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.431250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.431666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.431951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.432417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.433115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.436081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.445536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 997/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:15.450450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.450558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 998/1995] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:15.450676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.450928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.454055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.456005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.470594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7064b73-baca-4114-8f2b-c90ac2d70cd7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.477640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.477972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:15.478300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.478583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.478864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] PATH_INFO: `/v3/projects/ee559d5ad8d445ce81907f74f59ac4d3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.479392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.481159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee559d5ad8d445ce81907f74f59ac4d3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.483104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.491076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 998/1996] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:15.491076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.495737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:15.499867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77441a9-dde6-4670-81a2-21502697d768 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.507054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.508251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.508924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.508924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] PATH_INFO: `/v3/projects/d71064ec927e491096f817c0045542a3/users/157c9eac73c8469796bdcc545c51d7db/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.532362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71064ec927e491096f817c0045542a3, user_id=157c9eac73c8469796bdcc545c51d7db, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.536623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee559d5ad8d445ce81907f74f59ac4d3', 'request_id': 'req-d10b1ea4-7e9b-41d7-9f07-551d0377846e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.539564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.548651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee559d5ad8d445ce81907f74f59ac4d3', 'request_id': 'req-d10b1ea4-7e9b-41d7-9f07-551d0377846e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.562538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee559d5ad8d445ce81907f74f59ac4d3', 'request_id': 'req-d10b1ea4-7e9b-41d7-9f07-551d0377846e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.568422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 999/1997] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:15 2022] PUT /identity/v3/projects/d71064ec927e491096f817c0045542a3/users/157c9eac73c8469796bdcc545c51d7db/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.569707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.575431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] The token cache is being invalidate because project ee559d5ad8d445ce81907f74f59ac4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:15.575730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.576514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:15.578340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 999/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:15 2022] DELETE /identity/v3/projects/ee559d5ad8d445ce81907f74f59ac4d3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.579066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.580461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.661826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1ea4-7e9b-41d7-9f07-551d0377846e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.667770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774a8a9-618f-4c28-88fa-d3b0a9f98d44 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.673512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.674449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.674877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.675240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] PATH_INFO: `/v3/projects/20f68ed9be47485eb826d6bb1477c942/users/a05cc14cab8c434bbeb5262b4b55ff28/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.677401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f68ed9be47485eb826d6bb1477c942, user_id=a05cc14cab8c434bbeb5262b4b55ff28, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.680521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b770fd-fe06-4e9c-a561-c537795e1be7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.694235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1000/1999] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:15 2022] PUT /identity/v3/projects/20f68ed9be47485eb826d6bb1477c942/users/a05cc14cab8c434bbeb5262b4b55ff28/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:15.705659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0d64-6791-4264-b83b-3ca70a15562f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.705919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0d64-6791-4264-b83b-3ca70a15562f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.706290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0d64-6791-4264-b83b-3ca70a15562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.719057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:15.741121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8edb0d64-6791-4264-b83b-3ca70a15562f None None] MFA Rules not processed for user `157c9eac73c8469796bdcc545c51d7db`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:15.742456 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8edb0d64-6791-4264-b83b-3ca70a15562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.749627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.750262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.750647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.750798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.752878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.769968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.771916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.783333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1000/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:15.784276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:15.785706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.798382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908d1f5-2f36-403b-b541-c27a3ffa0d15 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:15.845637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1001/2001] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:15.845637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.845637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.845637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.882247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] MFA Rules not processed for user `a05cc14cab8c434bbeb5262b4b55ff28`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:15.883816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:15.900432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:15.901241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:15.901658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:15.902265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] PATH_INFO: `/v3/users/8a9010855b6b4d6fa672cb8033038d60` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:15.903863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9010855b6b4d6fa672cb8033038d60)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:15.906429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:15.990920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:16.024775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9010855b6b4d6fa672cb8033038d60'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.037444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9010855b6b4d6fa672cb8033038d60'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.051274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9010855b6b4d6fa672cb8033038d60'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.052080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9010855b6b4d6fa672cb8033038d60'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.053030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1002/2002] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:16.054017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:16.058188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.082867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9010855b6b4d6fa672cb8033038d60'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.105897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1001/2003] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:15 2022] DELETE /identity/v3/users/8a9010855b6b4d6fa672cb8033038d60 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:16.107457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:16.109140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.183557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f963b-946c-41df-acd4-97404e868f33 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:16.238322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86e6-1cf7-4612-9170-c7cb2a2f0a69 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:16.243425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:16.244380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:16.244656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:16.244927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:16.247190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.255754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:16.271323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:16.272070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:16.272388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:16.272706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:16.275241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.325768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:16.327376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:16.339068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1002/2004] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:16.350258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:16.351896 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:16.363126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1003/2005] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:16.415033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:16.416819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.557299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33d841-5f30-4081-8a0d-cdbd4353f28a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:16.560505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:16.561443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:16.561808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:16.562144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] PATH_INFO: `/v3/projects/c6d450e147c14e0ca89f01e35653302f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:16.564345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d450e147c14e0ca89f01e35653302f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:16.566514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:16.665967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d450e147c14e0ca89f01e35653302f', 'request_id': 'req-4f9528e7-ed05-456b-9528-c04f78d2a7da'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.685726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d450e147c14e0ca89f01e35653302f', 'request_id': 'req-4f9528e7-ed05-456b-9528-c04f78d2a7da'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.701295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d450e147c14e0ca89f01e35653302f', 'request_id': 'req-4f9528e7-ed05-456b-9528-c04f78d2a7da'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.723654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] The token cache is being invalidate because project c6d450e147c14e0ca89f01e35653302f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:16.724056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.725033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.727440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1003/2006] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:16 2022] DELETE /identity/v3/projects/c6d450e147c14e0ca89f01e35653302f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:16.732180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:16.751585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:16.752483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768fdab-eb99-48ca-9955-419c028f13ce service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:16.755463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:16.812001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:16.879769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:16.880049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9528e7-ed05-456b-9528-c04f78d2a7da admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:16.880651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:16.881029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:16.881400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] PATH_INFO: `/v3/users/f39e9419461e48b5b5642d812c33eee6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:16.882857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39e9419461e48b5b5642d812c33eee6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:16.885878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:16.887147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:16.891314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:16.891314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:16.891314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] PATH_INFO: `/v3/projects/b4f0222eefe84dd49fe341973685bf5a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:16.903750 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f0222eefe84dd49fe341973685bf5a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:16.903989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:16.904172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:16.963673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f0222eefe84dd49fe341973685bf5a', 'request_id': 'req-70c6ac13-38a0-450c-a07b-c979580defff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.973825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f0222eefe84dd49fe341973685bf5a', 'request_id': 'req-70c6ac13-38a0-450c-a07b-c979580defff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.979360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39e9419461e48b5b5642d812c33eee6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.983128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f0222eefe84dd49fe341973685bf5a', 'request_id': 'req-70c6ac13-38a0-450c-a07b-c979580defff'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.995795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39e9419461e48b5b5642d812c33eee6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.997146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] The token cache is being invalidate because project b4f0222eefe84dd49fe341973685bf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:16.997439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.998109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70c6ac13-38a0-450c-a07b-c979580defff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:16.999727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1004/2007] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:16 2022] DELETE /identity/v3/projects/b4f0222eefe84dd49fe341973685bf5a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:17.004479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.004789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.005058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.008253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39e9419461e48b5b5642d812c33eee6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.009550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39e9419461e48b5b5642d812c33eee6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.010423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24fd317f-be33-481f-a0c3-a739637d9ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39e9419461e48b5b5642d812c33eee6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.028364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:17.029366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1004/2008] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:16 2022] DELETE /identity/v3/users/f39e9419461e48b5b5642d812c33eee6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:17.036385 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.151240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1005/2009] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:17.156971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.157940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.157940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.179083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:17.180372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.188861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1005/2010] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:17.193762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.210510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a4690-548c-4bcb-bb52-e9ccdaf87315 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.215471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.217205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.217205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.217205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.217554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:17.217625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.220140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.262228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1006/2011] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:17.266229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.278114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20b187-ad21-46a4-bd07-a7dabd7b471e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.288221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.290722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.291950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.292470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.296345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.299652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.389415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1006/2012] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:17.393535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.407348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb84e-32bf-4595-890f-4bedb6e459f6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.502921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:17.521288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.522202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.525552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.525552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.525552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.530491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.556650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.558568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.594809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1318-c446-46fd-b053-32e53c3655d9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.602788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1007/2013] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:17.606323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.608440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.609098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.609418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.609641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] PATH_INFO: `/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.614243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ec6877ea7644e4ad8d5b322d14d995)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.616233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.633012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bc7e0-f8d7-4668-b0f0-e1f18ce91221 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.639683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.640565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.641083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.641680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.642569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.645811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.667683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1008/2014] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:17.670053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.685548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3dbc-fbbb-4b0f-a5d9-d672f24f3640 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.710423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ec6877ea7644e4ad8d5b322d14d995', 'request_id': 'req-fda646d5-f303-4da4-889e-d4c37abb528e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.720848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ec6877ea7644e4ad8d5b322d14d995', 'request_id': 'req-fda646d5-f303-4da4-889e-d4c37abb528e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.729105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ec6877ea7644e4ad8d5b322d14d995', 'request_id': 'req-fda646d5-f303-4da4-889e-d4c37abb528e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.755445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] The token cache is being invalidate because project e3ec6877ea7644e4ad8d5b322d14d995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:17.755778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.756492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fda646d5-f303-4da4-889e-d4c37abb528e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:17.758435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1007/2015] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:17 2022] DELETE /identity/v3/projects/e3ec6877ea7644e4ad8d5b322d14d995 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:17.765092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8768-fa8d-48dc-b180-76c5427ce0bc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.766826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8768-fa8d-48dc-b180-76c5427ce0bc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.766826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8768-fa8d-48dc-b180-76c5427ce0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.772196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.772851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.773152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.773390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.774205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.776027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.792573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1009/2016] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:17.796037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f70e8768-fa8d-48dc-b180-76c5427ce0bc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:17.796546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.797236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f70e8768-fa8d-48dc-b180-76c5427ce0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.798243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.812264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1008/2017] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:17.812639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61275-1c73-460a-bed6-079607e6183d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.818672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.819078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.819360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:17.819480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.821067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.821530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.822633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] PATH_INFO: `/v3/projects/2812b80a18364bada8f72ded3f7de55e/users/7c8875a4f9434d9b94f8a933170cbf85/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.839547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:17.840761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:17.843448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812b80a18364bada8f72ded3f7de55e, user_id=7c8875a4f9434d9b94f8a933170cbf85, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:17.846646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c15a-ee55-4062-b7bc-8a0c12cbfc28 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:17.851233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1009/2018] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:17.855692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:17.867751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1010/2019] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:17 2022] PUT /identity/v3/projects/2812b80a18364bada8f72ded3f7de55e/users/7c8875a4f9434d9b94f8a933170cbf85/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:17.869373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab147d-2ef7-4252-9197-5b89a8237709 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:17.878903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:17.879269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:17.879729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:17.901502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:17.935909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] MFA Rules not processed for user `7c8875a4f9434d9b94f8a933170cbf85`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:17.937129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.002225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.003014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.003328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.004450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.005228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:18.005648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.007445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf85e-dc87-4109-8220-2dfefcd783b3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.028415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1010/2020] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:18.030283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.030529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.031479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.054580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] MFA Rules not processed for user `157c9eac73c8469796bdcc545c51d7db`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:18.056373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.061056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1011/2021] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:18.062060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.075328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3ef0-9964-4104-80f4-e249c11ee89a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.080950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.081646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.081921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.082204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.082842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.085004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.118602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1012/2022] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:18 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:18.119830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.124883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.139046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:18.151502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1011/2023] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:18.152914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.165152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c36e-d14e-429a-834c-993ef3b190ed None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.206888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c858-541b-4215-b8db-4bd336253920 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.210932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.211702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.212058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.212617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.271686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.272612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.273011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.273656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.274470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.277304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.290366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.293080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.304734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1013/2024] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:18.309600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1012/2025] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:18 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:18.313807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.333997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4131-7040-4126-bd1a-579c43ad9129 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.341144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.342223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.342752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.343043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.343722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.347019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.362141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1014/2026] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:18.366182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.377531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ea3d-43bf-4ae1-b5ae-dcbe659113ae admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.382933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.383627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.383885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.384153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.384857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.389561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e077-972c-4a95-b76a-bcb554af0e5c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.402162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.403851 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1013/2027] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:18.415236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9f6a7-4d1f-407c-8a26-7fbc488011f1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.427281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.428660 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.430287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.430833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] PATH_INFO: `/v3/projects/333ceea1c1694b2680f0d96000e9901d/users/27346e0d7d61471c878aec6d3f27ab58/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.455728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=333ceea1c1694b2680f0d96000e9901d, user_id=27346e0d7d61471c878aec6d3f27ab58, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.459046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.485670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1015/2028] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:18 2022] PUT /identity/v3/projects/333ceea1c1694b2680f0d96000e9901d/users/27346e0d7d61471c878aec6d3f27ab58/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:18.497814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.498177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.498457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.503279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.509107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.557665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] MFA Rules not processed for user `27346e0d7d61471c878aec6d3f27ab58`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:18.558959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.596923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:18.669014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1014/2029] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:18.669974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5eef-a1ab-40d8-82ee-3a661f3e1f8a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.678781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.680967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.681255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.681536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] PATH_INFO: `/v3/users/0a5223725cd04611a28226602dc1919a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.682947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5223725cd04611a28226602dc1919a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.685637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.716798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.755398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:18.776833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5223725cd04611a28226602dc1919a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:18.789316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5223725cd04611a28226602dc1919a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:18.803131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5223725cd04611a28226602dc1919a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:18.803924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5223725cd04611a28226602dc1919a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:18.828096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151174-6e99-459c-a3df-be06b22e9c2d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.828685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2adc451e-b25c-4c20-87ad-f509c962fcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5223725cd04611a28226602dc1919a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:18.842976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.843731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.844074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.844591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.846092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1016/2030] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:18 2022] DELETE /identity/v3/users/0a5223725cd04611a28226602dc1919a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:18.850888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.851175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.851343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.851613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.872729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.876830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.877108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:18.878453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.899069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1015/2031] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:18.944044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.950246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:18.965958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966dcd3-5494-410d-b001-5d0219015881 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:18.971659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:18.972607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:18.974061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:18.974781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] PATH_INFO: `/v3/users/27346e0d7d61471c878aec6d3f27ab58` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:18.975980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27346e0d7d61471c878aec6d3f27ab58)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:18.976107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1017/2032] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:18.978657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:18.990032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:18.991814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:19.049932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27346e0d7d61471c878aec6d3f27ab58'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.066691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27346e0d7d61471c878aec6d3f27ab58'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.078412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27346e0d7d61471c878aec6d3f27ab58'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.079333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27346e0d7d61471c878aec6d3f27ab58'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.079965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b0937252-f506-4648-a2c3-e36bb55407d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27346e0d7d61471c878aec6d3f27ab58'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.085439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc38d42-bf72-46b7-a419-f9569d38f91a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:19.091379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e049-4129-418e-b944-22488c180fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:19.092061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e049-4129-418e-b944-22488c180fca service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:19.092342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e049-4129-418e-b944-22488c180fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:19.092612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e049-4129-418e-b944-22488c180fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:19.095404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5529e049-4129-418e-b944-22488c180fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:19.096645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1016/2033] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:18 2022] DELETE /identity/v3/users/27346e0d7d61471c878aec6d3f27ab58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:19.101956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:19.103011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:19.104072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:19.114588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e049-4129-418e-b944-22488c180fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:19.116406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e049-4129-418e-b944-22488c180fca service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:19.128137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1018/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:19.133091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:19.134370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:19.182404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:19.212374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1017/2035] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:19.222531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e049-4129-418e-b944-22488c180fca service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:19.224320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5529e049-4129-418e-b944-22488c180fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:19.236044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e049-4129-418e-b944-22488c180fca service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:19.303765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:19.304399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:19.304681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:19.304946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:19.312122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:19.318253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:19.320195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:19.340954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1019/2036] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:19.650284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:19.651887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:19.666868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b6bad-c012-4e86-b19b-389e2728b4d2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:19.673981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:19.674551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:19.674825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:19.675438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] PATH_INFO: `/v3/projects/adde9e0b500946ac8351f611a78dacb5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:19.676929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adde9e0b500946ac8351f611a78dacb5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:19.678849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:19.759952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adde9e0b500946ac8351f611a78dacb5', 'request_id': 'req-e5cbd325-32a3-43e8-a933-402333af69e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.766776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adde9e0b500946ac8351f611a78dacb5', 'request_id': 'req-e5cbd325-32a3-43e8-a933-402333af69e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.775974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adde9e0b500946ac8351f611a78dacb5', 'request_id': 'req-e5cbd325-32a3-43e8-a933-402333af69e5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.791293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] The token cache is being invalidate because project adde9e0b500946ac8351f611a78dacb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:19.791741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.792700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.802166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1018/2037] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:19 2022] DELETE /identity/v3/projects/adde9e0b500946ac8351f611a78dacb5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:19.806169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:19.817533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9621-5544-4736-bfc7-842dd8367d02 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:19.891838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:19.892655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:19.893183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:19.893709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] PATH_INFO: `/v3/users/a05cc14cab8c434bbeb5262b4b55ff28` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:19.895190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05cc14cab8c434bbeb5262b4b55ff28)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:19.897320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:19.967533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05cc14cab8c434bbeb5262b4b55ff28'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:19.977811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05cc14cab8c434bbeb5262b4b55ff28'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.000902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05cc14cab8c434bbeb5262b4b55ff28'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.001922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05cc14cab8c434bbeb5262b4b55ff28'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.021146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bd57c338-d9e6-4cc1-bfab-f0a2b9a21b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05cc14cab8c434bbeb5262b4b55ff28'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.029682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1020/2038] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:19 2022] DELETE /identity/v3/users/a05cc14cab8c434bbeb5262b4b55ff28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:20.224532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:20.226041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:20.248738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd325-32a3-43e8-a933-402333af69e5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:20.399331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:20.400007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.400280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.400542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] PATH_INFO: `/v3/projects/333ceea1c1694b2680f0d96000e9901d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.401869 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=333ceea1c1694b2680f0d96000e9901d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:20.404615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:20.482281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333ceea1c1694b2680f0d96000e9901d', 'request_id': 'req-9f971f17-8119-4e1d-9a0b-980b732c89fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.495359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333ceea1c1694b2680f0d96000e9901d', 'request_id': 'req-9f971f17-8119-4e1d-9a0b-980b732c89fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.503455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333ceea1c1694b2680f0d96000e9901d', 'request_id': 'req-9f971f17-8119-4e1d-9a0b-980b732c89fb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.508682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:20.526340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] The token cache is being invalidate because project 333ceea1c1694b2680f0d96000e9901d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:20.526798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.527567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f971f17-8119-4e1d-9a0b-980b732c89fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:20.532695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1019/2039] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:20 2022] DELETE /identity/v3/projects/333ceea1c1694b2680f0d96000e9901d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:20.536917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.537728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.537728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.564674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:20.566002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:20.684461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1021/2040] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:20.687639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.688514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.688813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.720933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:20.722452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:20.736717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1020/2041] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:20.737465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:20.751139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848371db-4c49-4b35-82b1-60860feae3c7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:20.758592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:20.759288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.759623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.760893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.763104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:20.763466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:20.767034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:20.784457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:20.794109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1022/2042] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:20.801186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:20.835502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5336d7-7272-40d8-adb4-14d408925fa4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:20.840929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:20.841567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.841839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.842106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.842765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:20.845347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:20.850023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:20.852340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:20.875184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aef0eb-c8dc-4cc2-94db-6f51a62d85fb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:20.888735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:20.889472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:20.889885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:20.890103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] PATH_INFO: `/v3/projects/20f68ed9be47485eb826d6bb1477c942` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:20.890249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1021/2043] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:20.891229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f68ed9be47485eb826d6bb1477c942)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:20.893530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:20.894270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.031437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f68ed9be47485eb826d6bb1477c942', 'request_id': 'req-6c6fae34-3341-4f49-8eff-f89495c02d5b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.057516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f68ed9be47485eb826d6bb1477c942', 'request_id': 'req-6c6fae34-3341-4f49-8eff-f89495c02d5b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.083553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f68ed9be47485eb826d6bb1477c942', 'request_id': 'req-6c6fae34-3341-4f49-8eff-f89495c02d5b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.086852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130c016-eb29-451d-aa8b-09ffbc7ae63d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.104333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] The token cache is being invalidate because project 20f68ed9be47485eb826d6bb1477c942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:21.104573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.105472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.108134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1023/2044] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:20 2022] DELETE /identity/v3/projects/20f68ed9be47485eb826d6bb1477c942 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:21.109202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.124125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.197837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.198862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.199348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.199856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.201930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.204003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ef07f-22be-414a-9216-5f62b96b2c54 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.236331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1022/2045] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:20 2022] POST /identity/v3/users => generated 287 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:21.236331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.236331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.236331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.264957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:21.267109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fae34-3341-4f49-8eff-f89495c02d5b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.267257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.273923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.274922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.275315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.275680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] PATH_INFO: `/v3/users/7c8875a4f9434d9b94f8a933170cbf85` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.276937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8875a4f9434d9b94f8a933170cbf85)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.278237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1023/2046] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:21.278960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.281898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.286906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.295766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a589f1-251a-4dc2-8cae-49e773731744 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.313646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.314510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.314891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.315288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.316052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.318261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a6e19-ff12-498f-87c3-f80c197d2595 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.331550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1024/2047] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:21.333381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6c55-d436-44be-8044-614349ad5450 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.333479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6c55-d436-44be-8044-614349ad5450 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.333876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6c55-d436-44be-8044-614349ad5450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.360505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-671e6c55-d436-44be-8044-614349ad5450 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:21.362259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-671e6c55-d436-44be-8044-614349ad5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.374273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1025/2048] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:21.378997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e6c55-d436-44be-8044-614349ad5450 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.388489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8875a4f9434d9b94f8a933170cbf85'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.394263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e6c55-d436-44be-8044-614349ad5450 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.399860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8875a4f9434d9b94f8a933170cbf85'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.405961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.407604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.407997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.409852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.411549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.413511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.432377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1026/2049] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:21.432377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.439983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8875a4f9434d9b94f8a933170cbf85'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.442012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8875a4f9434d9b94f8a933170cbf85'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.451120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea175-7c55-4b9d-8e83-e057342b0ebd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.467663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.468700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.469128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.469555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.470217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:21.470517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.472181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54321-67d7-4f3c-a969-396d4c57e69a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.478078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8875a4f9434d9b94f8a933170cbf85'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:21.485411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1024/2050] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:21 2022] DELETE /identity/v3/users/7c8875a4f9434d9b94f8a933170cbf85 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:21.486293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.487771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.493270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1027/2051] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:21.495734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.496010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.496276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.500657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:21.528925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:21.530158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.541657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:21.595672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56bd0d-2637-4cdf-b180-7fbb3640652e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.601779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.602485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.602769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.603064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] PATH_INFO: `/v3/projects/5e72ba7c34bb499f9b7fe5c8fb7a8823/users/ad2201f0d2994f8aa4b9193bf1243beb/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.616084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1028/2052] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:21.617116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.619078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.635611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe4ab3-9447-4a02-9aa5-f8286c3d7cf4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.636798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e72ba7c34bb499f9b7fe5c8fb7a8823, user_id=ad2201f0d2994f8aa4b9193bf1243beb, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.639617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.641555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.642543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.643015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.643522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.644579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.646592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572079-aca7-4297-8ccb-86e4a81011bc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.671083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1025/2053] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:21 2022] PUT /identity/v3/projects/5e72ba7c34bb499f9b7fe5c8fb7a8823/users/ad2201f0d2994f8aa4b9193bf1243beb/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:21.671628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.673452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.692652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1029/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:21.694085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.694472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.694840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.727861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] MFA Rules not processed for user `ad2201f0d2994f8aa4b9193bf1243beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:21.729408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:21.749784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a06f5-3755-431f-95f3-82ebfee35d68 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.809771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.810391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.810696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.810961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.825268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1030/2055] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:21.826284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.899780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40916-2cd7-4285-9a41-eddca5e5513f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.905726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.906395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.906775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.907146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.907920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.910090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.930355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:21.939322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1031/2056] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:21.941165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.947926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.950906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.963313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1026/2057] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:21.964163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:21.964550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc74aa-389d-4db6-99af-28b63a551866 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.970807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.971835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.972838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.972838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.973696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.976639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:21.978706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ab03-0895-4949-bd59-c827569dee76 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:21.985480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:21.986443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:21.986849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:21.987225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:21.988151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:21.989974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.008542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1027/2058] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:22.009142 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:22.010993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.027890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add1f4-9faa-4420-96cc-85bf10fca758 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.033606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1032/2059] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:21 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:22.036546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.037455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.037805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.038020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.043214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.044156 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.046084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.062863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1028/2060] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:22.064076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.077612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1c5-4d03-4cf8-9303-04f720b87750 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.136795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964f4a-28d5-42a8-87f1-738d2594c5bc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.143011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.143775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.144110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.144443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.145136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.147230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.157834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.159053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.159951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.160418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] PATH_INFO: `/v3/projects/ceb2b0a0422c421796c3021d8d69167c/users/0ee8a9cd727d4ea29c5b78033edc32a4/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.174282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1033/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:22 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:22.179846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.187539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb2b0a0422c421796c3021d8d69167c, user_id=0ee8a9cd727d4ea29c5b78033edc32a4, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.191903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8d6f9-b0af-4d6e-9e43-30a3d00c596d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.194013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcaeef-072a-4158-a09f-b95a711c6b39 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.200442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.201096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.201581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.201866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.202611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.204605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.221050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1029/2062] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:22 2022] PUT /identity/v3/projects/ceb2b0a0422c421796c3021d8d69167c/users/0ee8a9cd727d4ea29c5b78033edc32a4/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:22.223856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.224350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.224712 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.230875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1034/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:22.232278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.248384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33700-a09c-474e-98e3-d1bb01fad6ef admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.286235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] MFA Rules not processed for user `0ee8a9cd727d4ea29c5b78033edc32a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:22.288362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:22.337540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.338727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.339349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.339848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] PATH_INFO: `/v3/projects/c75a7925d3794965b7544515967f42c9/users/912464d98681407abfd332870c809c65/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.364659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75a7925d3794965b7544515967f42c9, user_id=912464d98681407abfd332870c809c65, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.368540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.396742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1035/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:22 2022] PUT /identity/v3/projects/c75a7925d3794965b7544515967f42c9/users/912464d98681407abfd332870c809c65/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:22.400973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.413307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1030/2065] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:22.425279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.427475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:22.531887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:22.541995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:22.563998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0f182-3599-404f-8656-c01f6c16b620 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.584708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9f5af-636d-4242-8f75-1937a47b0777 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.598329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.598951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.599250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.599521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.600167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.601798 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.621615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1036/2066] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:22.626754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.637773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd55a-3f4c-4f60-b631-134a474400df admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.639307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.640688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.641476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.642107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.656353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.658780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.658780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.659017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] PATH_INFO: `/v3/projects/c75a7925d3794965b7544515967f42c9/users/912464d98681407abfd332870c809c65/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.661149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75a7925d3794965b7544515967f42c9, user_id=912464d98681407abfd332870c809c65, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.664777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab463933-0c87-4db1-8997-fd8e71b1ca56 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.686513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1037/2067] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:22 2022] PUT /identity/v3/projects/c75a7925d3794965b7544515967f42c9/users/912464d98681407abfd332870c809c65/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:22.699034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.699405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.700719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:22.721815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:22.723568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:22.742487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] MFA Rules not processed for user `912464d98681407abfd332870c809c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:22.743734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:22.753072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1031/2068] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:22.827693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1038/2069] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:22.836308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:22.838083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:22.857435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee218-2c09-4051-b5eb-cce65eda7611 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:22.958554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:22.960126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:22.960612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:22.961043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:23.052390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:23.053784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c6e05-d02a-4822-a565-1a783baa8021 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:23.066233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1032/2070] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:23.479741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:23.481244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:23.559924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62e4eb-f49a-41f5-9672-fe34d6449004 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:23.564716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:23.565473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:23.565764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:23.566034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] PATH_INFO: `/v3/projects/2812b80a18364bada8f72ded3f7de55e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:23.567271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2812b80a18364bada8f72ded3f7de55e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:23.569312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:23.617356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2812b80a18364bada8f72ded3f7de55e', 'request_id': 'req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:23.624250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2812b80a18364bada8f72ded3f7de55e', 'request_id': 'req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:23.633490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2812b80a18364bada8f72ded3f7de55e', 'request_id': 'req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:23.636380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:23.651220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] The token cache is being invalidate because project 2812b80a18364bada8f72ded3f7de55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:23.651542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:23.652209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5d6a2bb-b9e4-4d3e-95af-ad3c91891940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:23.653785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1039/2071] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:23 2022] DELETE /identity/v3/projects/2812b80a18364bada8f72ded3f7de55e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:25.134349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.134870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.134957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.137033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1033/2072] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:24:25.167791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.168876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.169224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.194643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:25.197219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.211802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:25.214018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.227420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:25.293007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1040/2073] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:25.314998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:25.317544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.323404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d27454-d3a2-4493-bc93-6f2822e89833 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:25.330678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:25.331989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.332274 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.332773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] PATH_INFO: `/v3/users/a1cf493e27b3444299785f63c3b4630c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.333872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cf493e27b3444299785f63c3b4630c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:25.335294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de292-ab1b-46ec-a689-8c7db3ab1966 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:25.336444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:25.343856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:25.345179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.348391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.348391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.359861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:25.361514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:25.373279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1041/2074] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:25.415783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cf493e27b3444299785f63c3b4630c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.424353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cf493e27b3444299785f63c3b4630c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.431730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cf493e27b3444299785f63c3b4630c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.432408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cf493e27b3444299785f63c3b4630c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.444986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cf493e27b3444299785f63c3b4630c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.451552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1034/2075] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:25 2022] DELETE /identity/v3/users/a1cf493e27b3444299785f63c3b4630c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:25.626893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:25.637724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8f98-ed70-413e-b574-5591ab1e8046 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:25.708086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:25.708601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.708921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.709301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] PATH_INFO: `/v3/projects/458b4efddd8d4ab4a8831ee0b3cbce08` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.710444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=458b4efddd8d4ab4a8831ee0b3cbce08)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:25.712428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:25.764954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458b4efddd8d4ab4a8831ee0b3cbce08', 'request_id': 'req-138d5669-c3ac-4f6e-8321-be2a4ff313ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.767665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:25.769130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.771725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458b4efddd8d4ab4a8831ee0b3cbce08', 'request_id': 'req-138d5669-c3ac-4f6e-8321-be2a4ff313ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.778462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458b4efddd8d4ab4a8831ee0b3cbce08', 'request_id': 'req-138d5669-c3ac-4f6e-8321-be2a4ff313ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.783447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869394-f0eb-4632-b86f-f0f2f381fb30 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:25.794090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] The token cache is being invalidate because project 458b4efddd8d4ab4a8831ee0b3cbce08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:25.794395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.795093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-138d5669-c3ac-4f6e-8321-be2a4ff313ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.796706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1042/2076] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:25 2022] DELETE /identity/v3/projects/458b4efddd8d4ab4a8831ee0b3cbce08 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:25.802278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3207-9ee4-4ec4-8168-9635f5236698 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.802555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3207-9ee4-4ec4-8168-9635f5236698 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.802825 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3207-9ee4-4ec4-8168-9635f5236698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.811957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:25.825916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-400a3207-9ee4-4ec4-8168-9635f5236698 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:25.827558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-400a3207-9ee4-4ec4-8168-9635f5236698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.846273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:25.847230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.847411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.847686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] PATH_INFO: `/v3/users/ad2201f0d2994f8aa4b9193bf1243beb` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.848998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2201f0d2994f8aa4b9193bf1243beb)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:25.850960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:25.884728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:25.903848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1043/2077] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:25.910163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2201f0d2994f8aa4b9193bf1243beb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.911688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.912002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.912271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.927578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2201f0d2994f8aa4b9193bf1243beb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.934788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:25.936088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:25.940062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2201f0d2994f8aa4b9193bf1243beb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.941002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2201f0d2994f8aa4b9193bf1243beb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.950206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1044/2078] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:25.951135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:25.960657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773bf2e-15b4-4349-8063-33e68a460698 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:25.960809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b2c81195-98f1-4b71-9b9a-94517a03d720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2201f0d2994f8aa4b9193bf1243beb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:25.966402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:25.967160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.967587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.967852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.968549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:25.969092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:25.971070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1035/2079] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:25 2022] DELETE /identity/v3/users/ad2201f0d2994f8aa4b9193bf1243beb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:25.972369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:25.972497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:25.972721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:25.972995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:25.991050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1045/2080] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:25.992051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.003429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97bcc4-ce1e-4d91-ace0-f84fa92eee6c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.003621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:26.005161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.079542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.080164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.080429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.080765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.081432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.086251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1036/2081] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:26.086394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.095848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.097302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.122263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1046/2082] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:25 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:26.126580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.167722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5baf1-a7e1-446c-9860-1c9195c60b50 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.199113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3240e2e-f24e-485c-a655-84f74b2b223a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.204063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.204676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.204948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.205217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.205844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.207808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.217805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.218335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.218607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.218876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.226814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:26.228735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.230248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.236791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1047/2083] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:26 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:26.236791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.236791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.243346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1037/2084] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:26.244839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.249607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19ac9-9d1e-49f8-83b1-8cf4e8224f9d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.253127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:26.256624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.257276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.257553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.257826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] PATH_INFO: `/v3/users/0ee8a9cd727d4ea29c5b78033edc32a4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.258651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036406-5313-456e-bb2b-603fcd50a9ad service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.258973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee8a9cd727d4ea29c5b78033edc32a4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.262115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.267514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.268917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.270155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.270451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.271383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.273569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.287176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1038/2085] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:26.291705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.313183 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955362-15bb-43c9-bd1a-14ecb10da863 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.318772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.319492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.319772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.320044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.320731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.322321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.339150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1039/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:26.340375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.340533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee8a9cd727d4ea29c5b78033edc32a4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.353632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f335d-4d55-4fa7-bd73-1435829ed797 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.358839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee8a9cd727d4ea29c5b78033edc32a4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.361762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.362467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.362907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.363233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] PATH_INFO: `/v3/projects/6dd506f14dee483786f06f8286b8b698/users/7d01a63197c9404db457afbdc8274d5c/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.367611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee8a9cd727d4ea29c5b78033edc32a4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.368557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee8a9cd727d4ea29c5b78033edc32a4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.370245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a95007e4-278c-4b1a-a28c-1c5fac685f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee8a9cd727d4ea29c5b78033edc32a4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.385822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd506f14dee483786f06f8286b8b698, user_id=7d01a63197c9404db457afbdc8274d5c, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.388298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc970ffc-56f4-4305-b5d4-efa6d7a56ee7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.391833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1048/2087] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:26 2022] DELETE /identity/v3/users/0ee8a9cd727d4ea29c5b78033edc32a4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:26.396912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.397395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.397655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.406170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1040/2088] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:26 2022] PUT /identity/v3/projects/6dd506f14dee483786f06f8286b8b698/users/7d01a63197c9404db457afbdc8274d5c/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:26.419708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:26.420859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.421315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.421744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.422149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.471514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] MFA Rules not processed for user `7d01a63197c9404db457afbdc8274d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:26.472967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.519336 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1049/2089] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:26.531604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.533276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.574648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1041/2090] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:26.579074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.580552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.598337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8c0a-f855-4435-aa4f-66e9d96e4601 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.598706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dd386-2551-4698-a7ed-8e7cf14922fe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.602473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.603083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.603404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.603673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.603764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.604599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.605053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.605439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.606115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.608203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.614160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.615650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.626641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1050/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:26.641315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1042/2092] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:26 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:26.645823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.659690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072838-a437-4e31-8c32-f6c43a806afb service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.676041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:26.758604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.758604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.758604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.758604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.759143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.759143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.782793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1051/2093] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:26 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:26.786652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.800457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28560e-30a3-4638-aae0-2fa1dca8e6c6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.806101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.806965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.821403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.821898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.822767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.825300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.835893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.837637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.841515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1043/2094] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:26.846083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.853989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf46c8-df3b-4d24-a64c-cbf6bee3811c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.857850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6541-8fe6-498a-bf0a-c4d5bcd18ca9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:26.860513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.861280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.861630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.861929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] PATH_INFO: `/v3/projects/5e72ba7c34bb499f9b7fe5c8fb7a8823` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.863150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e72ba7c34bb499f9b7fe5c8fb7a8823)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.866829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.874630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:26.875368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:26.875652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:26.875919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] PATH_INFO: `/v3/projects/f1b28852b1bc4212b431ff6555ec39e8/users/08c00c8f4f8f4a7086023bf5293b1729/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:26.895340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b28852b1bc4212b431ff6555ec39e8, user_id=08c00c8f4f8f4a7086023bf5293b1729, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:26.898448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:26.914668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1044/2095] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:26 2022] PUT /identity/v3/projects/f1b28852b1bc4212b431ff6555ec39e8/users/08c00c8f4f8f4a7086023bf5293b1729/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:26.918555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.929174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e72ba7c34bb499f9b7fe5c8fb7a8823', 'request_id': 'req-0d4b674e-78be-4d34-b36e-0624adfb6ed2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.937731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e72ba7c34bb499f9b7fe5c8fb7a8823', 'request_id': 'req-0d4b674e-78be-4d34-b36e-0624adfb6ed2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.945004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e72ba7c34bb499f9b7fe5c8fb7a8823', 'request_id': 'req-0d4b674e-78be-4d34-b36e-0624adfb6ed2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.962364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] The token cache is being invalidate because project 5e72ba7c34bb499f9b7fe5c8fb7a8823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:26.962664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.963518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:26.967363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1052/2096] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:26 2022] DELETE /identity/v3/projects/5e72ba7c34bb499f9b7fe5c8fb7a8823 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:26.967363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:26.968692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:26.980868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:26.996727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a515fc-3d92-41b5-957e-af08515eaa02 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.037106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b674e-78be-4d34-b36e-0624adfb6ed2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.042363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.043032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.043298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.043572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] PATH_INFO: `/v3/projects/ceb2b0a0422c421796c3021d8d69167c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.044692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb2b0a0422c421796c3021d8d69167c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.046660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.056327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.056945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.057222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.057491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.058411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.060217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.070970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1045/2097] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:27.071974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.073910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.087656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c9d8-5096-4a6e-9c7b-9fa8cc638a8d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.089335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:27.104599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb2b0a0422c421796c3021d8d69167c', 'request_id': 'req-134bc177-2346-4c2c-b378-5d14d899960a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.111458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb2b0a0422c421796c3021d8d69167c', 'request_id': 'req-134bc177-2346-4c2c-b378-5d14d899960a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.117250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb2b0a0422c421796c3021d8d69167c', 'request_id': 'req-134bc177-2346-4c2c-b378-5d14d899960a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.131120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] The token cache is being invalidate because project ceb2b0a0422c421796c3021d8d69167c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:27.131435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.132623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.134488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1053/2098] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:26 2022] DELETE /identity/v3/projects/ceb2b0a0422c421796c3021d8d69167c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:27.135168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.136886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.147596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.148341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.148648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.148923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] PATH_INFO: `/v3/users/912464d98681407abfd332870c809c65` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.150067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=912464d98681407abfd332870c809c65)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.152307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.200749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912464d98681407abfd332870c809c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.204490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bc177-2346-4c2c-b378-5d14d899960a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.208626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912464d98681407abfd332870c809c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.209611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.210392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.210728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.211004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] PATH_INFO: `/v3/projects/f1b28852b1bc4212b431ff6555ec39e8/users/08c00c8f4f8f4a7086023bf5293b1729/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.212966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b28852b1bc4212b431ff6555ec39e8, user_id=08c00c8f4f8f4a7086023bf5293b1729, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.215818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91dc57-8267-40ed-95f3-8fd52dfa82f1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.216087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912464d98681407abfd332870c809c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.216738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912464d98681407abfd332870c809c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.226171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1054/2099] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:27 2022] PUT /identity/v3/projects/f1b28852b1bc4212b431ff6555ec39e8/users/08c00c8f4f8f4a7086023bf5293b1729/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:27.227409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92300d6-090f-477e-aa36-c18b272691d2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.227653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92300d6-090f-477e-aa36-c18b272691d2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.227920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92300d6-090f-477e-aa36-c18b272691d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.230990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4b14a645-018d-439f-a6a9-8881bc8fef8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912464d98681407abfd332870c809c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.237037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1046/2100] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:27 2022] DELETE /identity/v3/users/912464d98681407abfd332870c809c65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:27.238257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.238544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.238817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.257198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b92300d6-090f-477e-aa36-c18b272691d2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:27.258683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b92300d6-090f-477e-aa36-c18b272691d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.267227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:27.270815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] MFA Rules not processed for user `08c00c8f4f8f4a7086023bf5293b1729`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:27.272187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.333295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1055/2101] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:27.341311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.341597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.341868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.356254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1047/2102] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:27.365606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:27.366811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.370046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.372429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.377161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1056/2103] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:27.381098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.392079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687b32-bf0f-4fe2-965f-49d9ac93def3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.400287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.400966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.401242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.401589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.402327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:27.403434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.406745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.421357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1057/2104] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:27.425781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.436480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67641d-6324-429a-86f3-e67ad0810b9f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.441463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.442070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.442344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.442478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc4e8-4dcf-4bf0-aba0-f9cf256a1f91 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.443300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.443300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.447099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.447258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.448592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.448866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.449181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.465398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.471466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.483335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1048/2105] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:27.487017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1058/2106] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:27.491957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.505173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850f1b-54ef-47ef-af39-0d41306b4d56 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.546259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.548782 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.571099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:27.591821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.592442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.592720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.592990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.593624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.595617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.622029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1049/2107] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:27.622706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6c88-43b3-4cc3-bc90-893dd421a009 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.622923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.627371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.628010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.628316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.628582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] PATH_INFO: `/v3/projects/c75a7925d3794965b7544515967f42c9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.629692 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75a7925d3794965b7544515967f42c9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.631645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.656228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:27.679229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf456-8a62-4370-815e-7bd38a6c5f74 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.679491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75a7925d3794965b7544515967f42c9', 'request_id': 'req-64be4374-f5d3-4dd8-9f36-dec796733590'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.685827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75a7925d3794965b7544515967f42c9', 'request_id': 'req-64be4374-f5d3-4dd8-9f36-dec796733590'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.691902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75a7925d3794965b7544515967f42c9', 'request_id': 'req-64be4374-f5d3-4dd8-9f36-dec796733590'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.706046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] The token cache is being invalidate because project c75a7925d3794965b7544515967f42c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:27.706468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.707128 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:27.708677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1059/2108] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:27 2022] DELETE /identity/v3/projects/c75a7925d3794965b7544515967f42c9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:27.709471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.710898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.732072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.732692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.732959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.733229 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.735079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.775422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4374-f5d3-4dd8-9f36-dec796733590 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.781088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.781733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.782061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.782310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.782898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.784570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7553251-60b1-4f7f-86a8-1d0e7f6acf2b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.795009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1060/2109] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:27.796342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da198b-72b2-4ac5-8469-3f64d61fe5a5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.796621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da198b-72b2-4ac5-8469-3f64d61fe5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.796886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da198b-72b2-4ac5-8469-3f64d61fe5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.802637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.804137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.813598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1050/2110] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:27.814433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.826770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83b3a-4694-4a17-a8a6-42671ece1766 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.839360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-76da198b-72b2-4ac5-8469-3f64d61fe5a5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:27.840740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76da198b-72b2-4ac5-8469-3f64d61fe5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.841200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.841840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.842119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.842398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.843055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.844924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.857103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1051/2111] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:27.861259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.862047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1061/2112] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:27.863497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.863779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.864048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.872704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c963a-c745-44fb-a55e-18ed79dd83f8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.884902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.886175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.886628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.887251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] PATH_INFO: `/v3/projects/a9023c3916104f13b13ca8e5c162b755/users/153c26e117db4dfabc6aaced9dd0f140/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.891635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:27.893021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:27.901605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1062/2113] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:27.905883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.906779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9023c3916104f13b13ca8e5c162b755, user_id=153c26e117db4dfabc6aaced9dd0f140, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.909881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ada67d-432e-490c-8ad8-38a595b77e72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.915706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29520f06-f550-481d-82dc-bb494c2e4aad None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.927498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:27.928123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.928394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.928658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.929304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:27.929600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:27.931252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:27.933814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1052/2114] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:27 2022] PUT /identity/v3/projects/a9023c3916104f13b13ca8e5c162b755/users/153c26e117db4dfabc6aaced9dd0f140/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:27.947190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:27.948154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:27.948485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:27.960080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1063/2115] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:27.960983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:27.984105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6dd4-535a-48ed-a099-a3cd890e877a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:27.994694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:28.026371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] MFA Rules not processed for user `153c26e117db4dfabc6aaced9dd0f140`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:28.027761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:28.087412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.088136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.088483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.088817 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.090106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.092300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.116427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:28.122318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1064/2116] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:28.126377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.127982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1053/2117] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:28.131739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.143016 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14234b-78c5-4e7e-9344-634eb32af007 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.191514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b63b4e-4602-4025-a6f3-fb2776ded6c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.196793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.197405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.197675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.197937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.198636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.200643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.200753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.201367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.201901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.201901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.202523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.204483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.223126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1065/2118] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:28.227388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.232184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1054/2119] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:28.236164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.237871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a020e4-a9f7-41f3-9cb6-c8e2272d3c94 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.297199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.297807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.298078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.298343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.298979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.300115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db24-3b51-4c70-b373-207b32521dbb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.300688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.305427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.306032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.306309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.306582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.307247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.309777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.310690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1066/2120] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:28.314797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.326113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397831e-0801-4dcf-ab80-a5816575a6ec admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.331130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.331763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.332039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.332422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1055/2121] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:28.332556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.333077 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.334681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.336141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.345788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eda428-4f12-4bc9-81c7-b4fc887cadab admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.350287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1067/2122] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:28.350533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.351142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.351425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.351519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.351691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.352354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.354052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.362425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de41de-b586-425c-a3ef-cd949140979a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.365557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1056/2123] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:28.369922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.371137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.371872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.372131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.372390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] PATH_INFO: `/v3/projects/a037a47a127b40e09f30b177ef587a5a/users/33ed9d37c5df4ab98a2f8a4f884952c8/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.380937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:28.382650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765f22-76a5-4527-9c44-14bc0c314540 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.388052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.388644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.388914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.389184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a037a47a127b40e09f30b177ef587a5a, user_id=33ed9d37c5df4ab98a2f8a4f884952c8, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.389300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.389815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.391414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.391914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e536-e8a9-4d02-8744-b6b8ef868221 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.402343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1057/2124] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:28.406665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.407776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1068/2125] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:28 2022] PUT /identity/v3/projects/a037a47a127b40e09f30b177ef587a5a/users/33ed9d37c5df4ab98a2f8a4f884952c8/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:28.410435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.410734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.411025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.417067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521f05d-c500-45e3-b887-a25bd28c82b2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.431251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:28.432466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:28.471468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:28.487578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.488203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.488483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.488754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] PATH_INFO: `/v3/projects/1a282f8405174b978b2fced0940e8f95/users/0176d6201c284f739abfec4286c90e85/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.494953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1069/2126] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:28.504369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a282f8405174b978b2fced0940e8f95, user_id=0176d6201c284f739abfec4286c90e85, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.505427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.507056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a829d0a-bd85-4370-a4a7-1f11d1554c80 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.507567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:28.521114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1058/2127] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:28 2022] PUT /identity/v3/projects/1a282f8405174b978b2fced0940e8f95/users/0176d6201c284f739abfec4286c90e85/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:28.531045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.531374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.531643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.559508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] MFA Rules not processed for user `0176d6201c284f739abfec4286c90e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:28.560780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:28.565534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89f179-0b7e-40e1-8a6c-4390ee1e7c51 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.616445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.617053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.617324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.617588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.646792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1059/2128] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:28.648055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.687099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:28.692241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.693956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.705890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1070/2129] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:28.721896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ad3b-74fb-451c-88ec-4d892df86c5a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.726777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.727653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.727994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.728330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.729072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.731617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.763235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1060/2130] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:28.767211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.778140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727acdd-600a-49d6-9c82-4d3a22257864 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.856029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.856710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.856987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.857251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.858364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.860854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.890574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1071/2131] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:28 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:28.892300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.903258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a85f-c874-44d5-a9dc-70fd718d31f1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.907980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.908600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.908881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.909150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.909798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.911430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.923925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1061/2132] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:28.928257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.939565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70bc3f-b6b7-4e5c-b830-5040e3dcc3a4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:28.944752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:28.945413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:28.945691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:28.945964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] PATH_INFO: `/v3/projects/06d490d288064d1791be655ec70239d3/users/4f0899807d4e4060aa5856f2fc1e9fd4/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:28.962446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d490d288064d1791be655ec70239d3, user_id=4f0899807d4e4060aa5856f2fc1e9fd4, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:28.965885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:28.981404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1072/2133] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:28 2022] PUT /identity/v3/projects/06d490d288064d1791be655ec70239d3/users/4f0899807d4e4060aa5856f2fc1e9fd4/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:28.985501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:28.997759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facc98-b3a9-49df-a8f0-baef9a78898a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:29.043146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:29.084413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:29.085187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.085582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.085996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.086661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:29.088355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810cfa-0d25-4c27-8d81-c5738816e030 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:29.126212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1062/2134] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:29.127549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:29.142254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552f8c-f8ff-4aea-8737-9f23af03092c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:29.155898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:29.156944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.157919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.158449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] PATH_INFO: `/v3/projects/06d490d288064d1791be655ec70239d3/users/4f0899807d4e4060aa5856f2fc1e9fd4/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.163022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d490d288064d1791be655ec70239d3, user_id=4f0899807d4e4060aa5856f2fc1e9fd4, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:29.165901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:29.194847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1073/2135] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:29 2022] PUT /identity/v3/projects/06d490d288064d1791be655ec70239d3/users/4f0899807d4e4060aa5856f2fc1e9fd4/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:29.205710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fab4e-dfc1-46be-9c6a-bef916196b9d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.205710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fab4e-dfc1-46be-9c6a-bef916196b9d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.206108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fab4e-dfc1-46be-9c6a-bef916196b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.262591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4e7fab4e-dfc1-46be-9c6a-bef916196b9d None None] MFA Rules not processed for user `4f0899807d4e4060aa5856f2fc1e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:29.264399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e7fab4e-dfc1-46be-9c6a-bef916196b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:29.388337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1063/2136] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:29.402949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:29.408886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:29.509252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452ec99-527f-4dff-b138-9efbbc541ab8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:29.514551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:29.516112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.516604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.517067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.615538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:29.618191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:29.630641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:29.638075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1074/2137] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:29.663357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.663713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.664053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.696440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] MFA Rules not processed for user `33ed9d37c5df4ab98a2f8a4f884952c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:29.697776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:29.781004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1064/2138] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:29.794339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:29.795893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:29.810288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d9a5-0c24-4d0c-9acf-9bb3401ec6f9 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:29.818215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:29.819264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:29.819605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:29.819943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:29.830858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:29.832496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf05857-99c6-453e-94bd-65cf86122e6b service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:29.843475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1075/2139] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:31.206827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:31.217550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e9801-cb21-40a6-bea4-4ecbc1a43e85 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:31.221481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:31.222092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:31.222374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:31.222647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:31.236370 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:31.236897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:31.236897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:31.256183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] MFA Rules not processed for user `33ed9d37c5df4ab98a2f8a4f884952c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:31.257387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:31.264924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1076/2140] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:31.270027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:31.283575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:31.285021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:31.294893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1065/2141] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:31.921126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:31.933388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaefe-1535-4b11-9058-fcd654af5478 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:31.939485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:31.940102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:31.940376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:31.940827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:31.952328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:31.954586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136a501-b5de-4e3c-850f-bbc704f3178f service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:31.967115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1077/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:35.078049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:35.079957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:35.153367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694737e-760c-4dbd-ad2c-d51206a56814 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:35.158493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:35.159068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:35.159372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:35.159641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] PATH_INFO: `/v3/users/7d01a63197c9404db457afbdc8274d5c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:35.160781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d01a63197c9404db457afbdc8274d5c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:35.162721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:35.219701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d01a63197c9404db457afbdc8274d5c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:35.228194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d01a63197c9404db457afbdc8274d5c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:35.236017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d01a63197c9404db457afbdc8274d5c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:35.236740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d01a63197c9404db457afbdc8274d5c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:35.251665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d01a63197c9404db457afbdc8274d5c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:35.258248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1066/2143] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:35 2022] DELETE /identity/v3/users/7d01a63197c9404db457afbdc8274d5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:35.262558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:35.263029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:35.263121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:35.282057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:35.283323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:35.349970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1078/2144] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:35.360657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:35.362570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:35.435033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd54a-da1e-49c7-8cce-2adec892105f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:35.439450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:35.440086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:35.440366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:35.440639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:35.455282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:35.456911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:35.468521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1067/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:35.996623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:35.998240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.015789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6b416-d54b-4b53-b353-095166fc82c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:36.034642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:36.036266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:36.036266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:36.036266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] PATH_INFO: `/v3/users/153c26e117db4dfabc6aaced9dd0f140` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:36.037636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=153c26e117db4dfabc6aaced9dd0f140)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:36.040114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:36.141178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153c26e117db4dfabc6aaced9dd0f140'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.150357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:36.152838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.159002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153c26e117db4dfabc6aaced9dd0f140'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.168348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153c26e117db4dfabc6aaced9dd0f140'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.169152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153c26e117db4dfabc6aaced9dd0f140'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.169953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f3383b4c-d415-4698-a4b0-f6ebd52f2eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153c26e117db4dfabc6aaced9dd0f140'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.170313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca489e8-d4ca-476f-9e8f-bdea971d064b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:36.176053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:36.176780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:36.177291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:36.177576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] PATH_INFO: `/v3/projects/6dd506f14dee483786f06f8286b8b698` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:36.178815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd506f14dee483786f06f8286b8b698)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:36.181592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:36.184352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:36.212997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1079/2146] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:35 2022] DELETE /identity/v3/users/153c26e117db4dfabc6aaced9dd0f140 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:36.217398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7964-d10c-468f-8427-882a7f761625 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:36.217678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7964-d10c-468f-8427-882a7f761625 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:36.217949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7964-d10c-468f-8427-882a7f761625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:36.244601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-08da7964-d10c-468f-8427-882a7f761625 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:36.246216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08da7964-d10c-468f-8427-882a7f761625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.269059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd506f14dee483786f06f8286b8b698', 'request_id': 'req-14effcbf-9822-46c3-b2eb-0e58704cda2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.278968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd506f14dee483786f06f8286b8b698', 'request_id': 'req-14effcbf-9822-46c3-b2eb-0e58704cda2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.287029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd506f14dee483786f06f8286b8b698', 'request_id': 'req-14effcbf-9822-46c3-b2eb-0e58704cda2e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.295083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:36.303885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] The token cache is being invalidate because project 6dd506f14dee483786f06f8286b8b698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:36.304678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.305879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.309586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1068/2147] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:36 2022] DELETE /identity/v3/projects/6dd506f14dee483786f06f8286b8b698 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:36.313781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:36.315298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.334369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1080/2148] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:36.341298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7964-d10c-468f-8427-882a7f761625 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:36.342719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08da7964-d10c-468f-8427-882a7f761625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.415145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14effcbf-9822-46c3-b2eb-0e58704cda2e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:36.416980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7964-d10c-468f-8427-882a7f761625 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:36.420176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:36.420828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:36.421074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:36.421188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:36.421688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:36.421960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] PATH_INFO: `/v3/users/08c00c8f4f8f4a7086023bf5293b1729` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:36.422058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:36.422221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:36.423126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c00c8f4f8f4a7086023bf5293b1729)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:36.425119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:36.432187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:36.433881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:36.444660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1081/2149] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:36.504879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c00c8f4f8f4a7086023bf5293b1729'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.513811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c00c8f4f8f4a7086023bf5293b1729'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.525487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c00c8f4f8f4a7086023bf5293b1729'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.526669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c00c8f4f8f4a7086023bf5293b1729'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.545348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c00c8f4f8f4a7086023bf5293b1729'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:36.552321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1069/2150] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:36 2022] DELETE /identity/v3/users/08c00c8f4f8f4a7086023bf5293b1729 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:36.969977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:36.971614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:36.985432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e5f6-3760-4d82-ac4b-5c21a21588c2 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.059084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.059756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.060033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.060302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] PATH_INFO: `/v3/projects/a9023c3916104f13b13ca8e5c162b755` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.061487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9023c3916104f13b13ca8e5c162b755)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.063445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.104436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.106184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.129422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9023c3916104f13b13ca8e5c162b755', 'request_id': 'req-f1e30c63-6220-4143-8f30-90df09cb19d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.131802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56417c3-5cff-43dc-9acc-3d6bdd2f0065 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.144391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9023c3916104f13b13ca8e5c162b755', 'request_id': 'req-f1e30c63-6220-4143-8f30-90df09cb19d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.147027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:37.159627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9023c3916104f13b13ca8e5c162b755', 'request_id': 'req-f1e30c63-6220-4143-8f30-90df09cb19d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.186009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] The token cache is being invalidate because project a9023c3916104f13b13ca8e5c162b755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:37.186335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.188390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.190245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1082/2151] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:36 2022] DELETE /identity/v3/projects/a9023c3916104f13b13ca8e5c162b755 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:37.194063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.195469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.211862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:37.231849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.232553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.233897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.234328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] PATH_INFO: `/v3/projects/f1b28852b1bc4212b431ff6555ec39e8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.236315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b28852b1bc4212b431ff6555ec39e8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.239160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.313032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30c63-6220-4143-8f30-90df09cb19d8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.324548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b28852b1bc4212b431ff6555ec39e8', 'request_id': 'req-06138a10-4d21-42b0-8cc1-7fb97cb99a92'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.335243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b28852b1bc4212b431ff6555ec39e8', 'request_id': 'req-06138a10-4d21-42b0-8cc1-7fb97cb99a92'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.346623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b28852b1bc4212b431ff6555ec39e8', 'request_id': 'req-06138a10-4d21-42b0-8cc1-7fb97cb99a92'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.358770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] The token cache is being invalidate because project f1b28852b1bc4212b431ff6555ec39e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:37.359409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.360267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06138a10-4d21-42b0-8cc1-7fb97cb99a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.362018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1070/2152] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:37 2022] DELETE /identity/v3/projects/f1b28852b1bc4212b431ff6555ec39e8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:37.363661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f96f-2dd2-4b7c-89e7-765f5ed6ed00 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.364148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f96f-2dd2-4b7c-89e7-765f5ed6ed00 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.364613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f96f-2dd2-4b7c-89e7-765f5ed6ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.381942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.382794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.383557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.383837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] PATH_INFO: `/v3/users/0176d6201c284f739abfec4286c90e85` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.385196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0176d6201c284f739abfec4286c90e85)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.387537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.389271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2118f96f-2dd2-4b7c-89e7-765f5ed6ed00 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:37.390891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2118f96f-2dd2-4b7c-89e7-765f5ed6ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.454206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0176d6201c284f739abfec4286c90e85'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.459496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1071/2153] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:37.460999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.461497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.461995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.471090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0176d6201c284f739abfec4286c90e85'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.485062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:37.486851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.491333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0176d6201c284f739abfec4286c90e85'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.492112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0176d6201c284f739abfec4286c90e85'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.493250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-82a428c3-a5be-420a-ae9e-a488916d6e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0176d6201c284f739abfec4286c90e85'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:37.503588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1072/2154] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:37.503588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.503588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.514901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1083/2155] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:37 2022] DELETE /identity/v3/users/0176d6201c284f739abfec4286c90e85 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:37.516613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.516967 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.517330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.573222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:37.575358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.585529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:37.626599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:37.648339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e3bc-5cc2-4c2e-b2d2-637a1605c1b5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.671443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1084/2156] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:37.676375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.691550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d253a9-ba2c-4309-920e-99278ef38853 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.703514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.706678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.707467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.707947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.708872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:37.709777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.714189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.737819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1085/2157] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:37.739625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.749570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.750353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.751025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.751419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.753754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:37.755506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb39c0-8ecf-4e59-b745-370dd45a1545 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.761911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.762725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.763528 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.763815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.764460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.766734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.813114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1086/2158] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:37 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:37.814744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.832985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.835017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.856545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1073/2159] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:37.896230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8064-5246-4863-a3f1-4352fa61adbc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.902267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.902946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.903271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.903525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.904258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.906378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:37.944686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1087/2160] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:37 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:37.949543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:37.972202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf714ee-b868-4797-a9b7-5e39902e0eef service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:37.981846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:37.982619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:37.983000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:37.983412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:37.985548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:37.987432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.001780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1074/2161] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:38.006908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.026572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417098-976c-4912-b8a5-ab20eb7f5109 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.038062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.038780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.039133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.040089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.040757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.042659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a442a-564b-4cb4-b565-4018e9476da2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.055183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1088/2162] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:38.059581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.071377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf30b9-974c-4939-8cf7-1dc808a1b1c4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.080886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.082435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.082938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.083301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] PATH_INFO: `/v3/projects/eba191e4d250481289f5fbd366f817f1/users/061c33474ae647d7a1ba448d9b238c8b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.105635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba191e4d250481289f5fbd366f817f1, user_id=061c33474ae647d7a1ba448d9b238c8b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.108793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.128518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1075/2163] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:38 2022] PUT /identity/v3/projects/eba191e4d250481289f5fbd366f817f1/users/061c33474ae647d7a1ba448d9b238c8b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:38.139357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.139847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.140221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.179589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] MFA Rules not processed for user `061c33474ae647d7a1ba448d9b238c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:38.181282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.250506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.252495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.277721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1089/2164] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:38.278804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.304195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:38.316919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:38.336808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baf7d5-8c41-49c1-8175-763a9d3a640f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.342550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.343298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.343651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.344021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] PATH_INFO: `/v3/projects/1a282f8405174b978b2fced0940e8f95` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.345383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a282f8405174b978b2fced0940e8f95)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.347524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.366783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc8d56-37e1-4b41-b290-75a9263e996e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.372684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.373383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.373734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.374074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.375269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.376724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.400153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a282f8405174b978b2fced0940e8f95', 'request_id': 'req-63701b85-a5ee-4908-b46b-dd9531eb05f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.408426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a282f8405174b978b2fced0940e8f95', 'request_id': 'req-63701b85-a5ee-4908-b46b-dd9531eb05f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.409453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1090/2165] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:38 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:38.413504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.415329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a282f8405174b978b2fced0940e8f95', 'request_id': 'req-63701b85-a5ee-4908-b46b-dd9531eb05f4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.428619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] The token cache is being invalidate because project 1a282f8405174b978b2fced0940e8f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:38.428910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.429570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.434314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1076/2166] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:38 2022] DELETE /identity/v3/projects/1a282f8405174b978b2fced0940e8f95 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:38.435349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.436702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.488318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda03cd1-a4da-437c-ac12-1e5c738335de admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.494820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.495535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.495933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.496337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.497110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.499496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.520849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701b85-a5ee-4908-b46b-dd9531eb05f4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.525760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.526424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.526749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.527878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] PATH_INFO: `/v3/users/4f0899807d4e4060aa5856f2fc1e9fd4` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.529106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0899807d4e4060aa5856f2fc1e9fd4)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.530034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1091/2167] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:38 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:38.531033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.533935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.535795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.550766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafc2f6-9f31-48fa-9ff8-ca6fb0ff4502 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.556682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.557304 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.557595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.557925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.558580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.560437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757d4e0-928d-4878-9b3e-8ed26c7e453b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.572698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1092/2168] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:38.577684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.578138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.578445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.586425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0899807d4e4060aa5856f2fc1e9fd4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.597959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0899807d4e4060aa5856f2fc1e9fd4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.601071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:38.602401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.607597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0899807d4e4060aa5856f2fc1e9fd4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.608636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0899807d4e4060aa5856f2fc1e9fd4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.621865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:38.623609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0899807d4e4060aa5856f2fc1e9fd4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:38.631847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1077/2169] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:38 2022] DELETE /identity/v3/users/4f0899807d4e4060aa5856f2fc1e9fd4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:38.632673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.635845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.696628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1093/2170] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:38.713335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.715037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.728992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354fa3c-0a55-45bd-8456-04ce20a59084 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.735161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.736267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.736726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.737144 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] PATH_INFO: `/v3/projects/0bca77816e2c479cbf580eea1c344be6/users/a80dbacd6f07414eab2768b850dd467f/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.758054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:38.766808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bca77816e2c479cbf580eea1c344be6, user_id=a80dbacd6f07414eab2768b850dd467f, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.769825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.789279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1078/2171] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:38 2022] PUT /identity/v3/projects/0bca77816e2c479cbf580eea1c344be6/users/a80dbacd6f07414eab2768b850dd467f/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:38.793883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.807545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141586c1-ce0d-4c06-af4c-61319b47235a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.886481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5ac1-ae95-4319-9b05-d735a2d427f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.886868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.887527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.887802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.888069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.892333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.893997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.894281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.894556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.895924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.898629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.911247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1079/2172] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:38.915060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.925691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0c66-6145-4879-b229-0c40da6b9882 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:38.930490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:38.931143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.931454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.931725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] PATH_INFO: `/v3/projects/0bca77816e2c479cbf580eea1c344be6/users/a80dbacd6f07414eab2768b850dd467f/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.933856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bca77816e2c479cbf580eea1c344be6, user_id=a80dbacd6f07414eab2768b850dd467f, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.936589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3f6f3-2b79-43e7-ae1a-08b9401e8f6a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.947421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1080/2173] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:38 2022] PUT /identity/v3/projects/0bca77816e2c479cbf580eea1c344be6/users/a80dbacd6f07414eab2768b850dd467f/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:38.959238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:38.959526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:38.959797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:38.966780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:38.968618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:38.980421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1094/2174] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:38.996756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] MFA Rules not processed for user `a80dbacd6f07414eab2768b850dd467f`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:38.997525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:38.998115 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:38.998812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.016939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35fea-5a12-4818-b285-c114ab919b5f service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.072358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.099495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1081/2175] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:39.110675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.111531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.111967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.112086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.112269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] PATH_INFO: `/v3/projects/06d490d288064d1791be655ec70239d3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.113616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.113743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d490d288064d1791be655ec70239d3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.115908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.128008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.180364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6a7b-da61-4b7c-8c17-b03711fab17d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.182022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d490d288064d1791be655ec70239d3', 'request_id': 'req-8e555f70-2581-470a-bb3b-7f21563727c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.189316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d490d288064d1791be655ec70239d3', 'request_id': 'req-8e555f70-2581-470a-bb3b-7f21563727c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.195303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d490d288064d1791be655ec70239d3', 'request_id': 'req-8e555f70-2581-470a-bb3b-7f21563727c3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.216074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] The token cache is being invalidate because project 06d490d288064d1791be655ec70239d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:39.216487 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.217377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8e555f70-2581-470a-bb3b-7f21563727c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.224188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1095/2176] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:38 2022] DELETE /identity/v3/projects/06d490d288064d1791be655ec70239d3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:39.225609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684f7c-66e2-4084-88aa-3e1d9dffa74d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.225900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684f7c-66e2-4084-88aa-3e1d9dffa74d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.226175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684f7c-66e2-4084-88aa-3e1d9dffa74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.254030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3f684f7c-66e2-4084-88aa-3e1d9dffa74d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:39.254818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.255346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3f684f7c-66e2-4084-88aa-3e1d9dffa74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.255768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.256306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.256725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.259126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.327474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1096/2177] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:39.336410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.336697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.336972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.355074 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.356884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:39.358116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.358677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.367314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1097/2178] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:39.371504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.374977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1082/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:39.382234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a036609-e912-407b-a17d-7c7a3f70f1e4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.386977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.387632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.388997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.388997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.389172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:39.389763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.391524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.408093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1098/2180] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:39.418747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.418955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.421042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.430475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0bc1-4331-4aab-ab90-f01d093ddfc6 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.435258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.435938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.436397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.436745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.436841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57a3c-dc2c-4507-89a3-4d00fcd56206 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.437477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.439433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feab512-4085-48cc-b19d-124a559c223b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.441539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.442166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.442442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.442707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] PATH_INFO: `/v3/users/061c33474ae647d7a1ba448d9b238c8b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.443893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061c33474ae647d7a1ba448d9b238c8b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.445816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.477091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1083/2181] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:39.478516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28857-c0a7-455f-b0f5-c24eede37622 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.478799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28857-c0a7-455f-b0f5-c24eede37622 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.479064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28857-c0a7-455f-b0f5-c24eede37622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.501556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f2e28857-c0a7-455f-b0f5-c24eede37622 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:39.503078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2e28857-c0a7-455f-b0f5-c24eede37622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.504125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061c33474ae647d7a1ba448d9b238c8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.517951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061c33474ae647d7a1ba448d9b238c8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.524358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.526701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061c33474ae647d7a1ba448d9b238c8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.528635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061c33474ae647d7a1ba448d9b238c8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.529393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061c33474ae647d7a1ba448d9b238c8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:39.534508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.549110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1099/2182] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:39 2022] DELETE /identity/v3/users/061c33474ae647d7a1ba448d9b238c8b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:39.550038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.551691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.570580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1084/2183] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:39.578349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.578639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.578916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.601263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:39.602702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.641177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd9d7-b3d4-483f-bbf1-acc3ee89bf90 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.646413 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.647041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.647353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.647646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.648283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.650257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.672909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1085/2184] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:39.672909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.672909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.678238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1100/2185] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:39.681275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.684248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:39.752563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ac17e-30da-451d-b3b5-16ca89b9ac9b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.753195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8fffc-ee48-4ec1-b141-2490fb72ded2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.756399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.757017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.757299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.757568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.758625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.759607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.759943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.760164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.769514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.771372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.786823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1101/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:39.788030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.800353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63d3d-b41e-4e27-ba64-eb6aee776502 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.806514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.808158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.808728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.809017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.810148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.812376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.826223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.830062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1102/2187] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:39.830195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.831167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.837219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1086/2188] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:39.846383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619688a-69c5-4c20-875e-39643307a2bb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.851837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.852458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.852737 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.853006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.853680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.855705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cff7e-fb61-4b67-8354-09cedb2a671a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.866552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1103/2189] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:39.871436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:39.883143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dedcce-4e8e-4043-93ee-dbeddb4ddd71 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:39.888051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:39.888793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.889141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.889489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] PATH_INFO: `/v3/projects/ce0e6f94e4d7485aac4a0059d062eea7/users/42ebda9374a24a0e8349e29e5eb9ba81/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.912020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0e6f94e4d7485aac4a0059d062eea7, user_id=42ebda9374a24a0e8349e29e5eb9ba81, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:39.914988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:39.917936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:39.939579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1087/2190] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:39 2022] PUT /identity/v3/projects/ce0e6f94e4d7485aac4a0059d062eea7/users/42ebda9374a24a0e8349e29e5eb9ba81/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:39.950872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:39.951152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:39.951468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:39.989333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] MFA Rules not processed for user `42ebda9374a24a0e8349e29e5eb9ba81`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:39.992104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.059594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:40.083125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1104/2191] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:40.094877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:40.096651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.195298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:40.196880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.222960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cadb8f-aa81-49db-9a50-596b3a075454 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:40.227082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:40.228602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:40.228602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:40.228602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:40.248672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:40.250376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb3eea-8335-4368-a9d6-f401beb48a0a service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:40.265362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1088/2192] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:40.295833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:40.296329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:40.296649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:40.305055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63bbc8-70a3-4255-adfd-2771a743cf9c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:40.310894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:40.311584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:40.311868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:40.312139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] PATH_INFO: `/v3/projects/eba191e4d250481289f5fbd366f817f1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:40.313404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba191e4d250481289f5fbd366f817f1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:40.316198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:40.321946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:40.323388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.373976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba191e4d250481289f5fbd366f817f1', 'request_id': 'req-7bb0debe-02a4-4fcb-99d9-f2be6858b648'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.381118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba191e4d250481289f5fbd366f817f1', 'request_id': 'req-7bb0debe-02a4-4fcb-99d9-f2be6858b648'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.386037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1089/2193] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:40.388192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba191e4d250481289f5fbd366f817f1', 'request_id': 'req-7bb0debe-02a4-4fcb-99d9-f2be6858b648'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.399141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:40.402748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] The token cache is being invalidate because project eba191e4d250481289f5fbd366f817f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:40.403048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.403775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.405492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1105/2194] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:40 2022] DELETE /identity/v3/projects/eba191e4d250481289f5fbd366f817f1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:40.412198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:40.414561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.475546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5981cc-a415-4ba2-a222-312a05aa2477 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:40.494721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0debe-02a4-4fcb-99d9-f2be6858b648 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:40.497625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:40.500020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:40.500666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:40.500996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:40.501275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] PATH_INFO: `/v3/users/a80dbacd6f07414eab2768b850dd467f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:40.502382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80dbacd6f07414eab2768b850dd467f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:40.505223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:40.531899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:40.546776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:40.547632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:40.547917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:40.548350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:40.550333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:40.562303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80dbacd6f07414eab2768b850dd467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.575743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80dbacd6f07414eab2768b850dd467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.588105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80dbacd6f07414eab2768b850dd467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.589150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80dbacd6f07414eab2768b850dd467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.589948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80dbacd6f07414eab2768b850dd467f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:40.607127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1106/2195] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:40 2022] DELETE /identity/v3/users/a80dbacd6f07414eab2768b850dd467f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:40.616402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:40.618412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96d64-876b-4a19-9de1-f18ea9a2c25e service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:40.629853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1090/2196] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:24:40.950849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:40.950849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:41.051691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756356-4c9c-41a6-a82b-c5361af85485 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.057510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.058442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.058873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.059324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] PATH_INFO: `/v3/projects/0bca77816e2c479cbf580eea1c344be6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.060664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bca77816e2c479cbf580eea1c344be6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.063627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.125595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bca77816e2c479cbf580eea1c344be6', 'request_id': 'req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:41.131897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bca77816e2c479cbf580eea1c344be6', 'request_id': 'req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:41.144009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bca77816e2c479cbf580eea1c344be6', 'request_id': 'req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:41.159052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] The token cache is being invalidate because project 0bca77816e2c479cbf580eea1c344be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:41.159392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:41.160552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3488ac93-0c41-4dda-aed0-eaf5ca6cd53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:41.162218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1107/2197] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:40 2022] DELETE /identity/v3/projects/0bca77816e2c479cbf580eea1c344be6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:41.168365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.168654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.168939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.212927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:41.214796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:41.288441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1091/2198] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:41.296755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.297052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.297332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.318341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:41.319598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:41.338804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1108/2199] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:41.343808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.356707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203da04-efb2-466d-bc18-b24b5f97cc1f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.362801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.363478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.364204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.364518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.365188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:41.365493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.367111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.398775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1092/2200] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:41.399925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.409424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf0d2-5de0-48b0-be25-a8f5a6c490f6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.420173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.421053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.421377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.421695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.422438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.424576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.450784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:41.467263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1109/2201] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:41 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:41.469572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.483481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ccaac-f218-41d8-8ae4-b979a4ca5cc6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.549409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:41.559258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.559957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.560237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.565605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.566343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.568659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.595341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1093/2202] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:41 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:41.598966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.610548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231f1a-cb4f-485a-bb3e-632316e1a8ad admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.615256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.615931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.616293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.616562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.617368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.619416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.634266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1110/2203] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:41.639020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.650716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977630-c7ce-4a91-a1fb-46a484e384c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.656783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.657486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.657864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.658130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.658787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.660479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdd731-88dd-43e4-a8c3-eea9a10042f5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.672429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1094/2204] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:41.676926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.689877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312a43a-4e54-4c21-87be-a21e1a80c7b8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.694477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.699147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.699147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.699147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] PATH_INFO: `/v3/projects/d2d3c472e8034fbda0a4e180c01fa7b0/users/d3ef9ac05abc40fd868c471442243924/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.712807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d3c472e8034fbda0a4e180c01fa7b0, user_id=d3ef9ac05abc40fd868c471442243924, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.715675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.731909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1111/2205] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:41 2022] PUT /identity/v3/projects/d2d3c472e8034fbda0a4e180c01fa7b0/users/d3ef9ac05abc40fd868c471442243924/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:41.737905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a16f7-701a-4edb-bda3-223ebcb482c0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.739527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a16f7-701a-4edb-bda3-223ebcb482c0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.739835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a16f7-701a-4edb-bda3-223ebcb482c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.761782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-743a16f7-701a-4edb-bda3-223ebcb482c0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:41.763078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-743a16f7-701a-4edb-bda3-223ebcb482c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:41.832368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1095/2206] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:41.842736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:41.846132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:41.913447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdeb5e-414d-4ef0-aec5-245bd62e2691 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:41.917213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:41.917986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:41.918097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:41.918398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:41.931597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:41.933694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:41.943150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1112/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:42.717408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:42.717949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:42.717949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:42.755639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] MFA Rules not processed for user `d3ef9ac05abc40fd868c471442243924`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:42.757208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:42.846499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1096/2208] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:42.852525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:42.863780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710660-97fe-449b-aab7-11bae541cd62 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:42.869885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:42.870966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:42.871457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:42.871877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:42.872819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:42.875550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:42.920031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1113/2209] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:42 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:42.924785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:42.941924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4af5-3eed-40cc-b261-21aec165f812 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:42.986542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:42.990099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:43.045810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.046591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.046865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.047132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.048412 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.050756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.062235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:43.079591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1097/2210] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:42 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:43.084707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.097883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1c0a-7a7e-4686-88d2-60f4a2e37eb9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.105232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.105911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317025-659a-4972-b28a-97fdd33b94e9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.106410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.106752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.107182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.108791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.111141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.111485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.112407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.112796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.113241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] PATH_INFO: `/v3/users/157c9eac73c8469796bdcc545c51d7db` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.114767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157c9eac73c8469796bdcc545c51d7db)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.116723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.133353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1098/2211] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:43.134862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.152619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45b3c-8951-47da-8329-2de7d1979b5f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.166012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.166771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.167102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.167556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] PATH_INFO: `/v3/projects/eb056c1c17934900bcda9b4a6af63e29/users/fe48762436cd4f73868e4bcef2de333e/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.186249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb056c1c17934900bcda9b4a6af63e29, user_id=fe48762436cd4f73868e4bcef2de333e, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.188406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157c9eac73c8469796bdcc545c51d7db'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.189720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.190295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:43.208694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157c9eac73c8469796bdcc545c51d7db'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.218075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157c9eac73c8469796bdcc545c51d7db'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.219452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157c9eac73c8469796bdcc545c51d7db'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.220759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-55330d16-06b1-40c7-85f7-a16611e4eb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157c9eac73c8469796bdcc545c51d7db'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.220931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1099/2212] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:43 2022] PUT /identity/v3/projects/eb056c1c17934900bcda9b4a6af63e29/users/fe48762436cd4f73868e4bcef2de333e/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:43.224962 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.227837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:43.244518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1114/2213] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:42 2022] DELETE /identity/v3/users/157c9eac73c8469796bdcc545c51d7db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:43.246216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.246596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.246972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.274604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:43.275891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:43.319422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c926e9-e6a9-4563-a399-acef22ca4bcf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.345184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1115/2214] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:43.357219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.358706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:43.390077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.390724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.391006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.391310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.391991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.393614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.409559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1100/2215] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:24:43.411909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.423445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4c99-385d-4486-a85e-a156d1d618bc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.428392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.429215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.429589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.430032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] PATH_INFO: `/v3/projects/eb056c1c17934900bcda9b4a6af63e29/users/fe48762436cd4f73868e4bcef2de333e/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.432003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee569-815e-4157-b833-38e10860e75f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.432231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb056c1c17934900bcda9b4a6af63e29, user_id=fe48762436cd4f73868e4bcef2de333e, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.435603 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.435805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.436573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.436850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.437114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.446718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.448198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba35107-b373-40e4-a34d-e15859abf582 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.448480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1101/2216] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:43 2022] PUT /identity/v3/projects/eb056c1c17934900bcda9b4a6af63e29/users/fe48762436cd4f73868e4bcef2de333e/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:43.461584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1116/2217] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:43.741493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:43.745286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:43.825471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:43.849136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcaf1-532d-4e6f-8883-f78821067dc3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:43.854182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:43.857914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.857914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.857914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] PATH_INFO: `/v3/projects/d71064ec927e491096f817c0045542a3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.859502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71064ec927e491096f817c0045542a3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:43.861588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:43.915087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71064ec927e491096f817c0045542a3', 'request_id': 'req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.924146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71064ec927e491096f817c0045542a3', 'request_id': 'req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.930536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71064ec927e491096f817c0045542a3', 'request_id': 'req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.944679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] The token cache is being invalidate because project d71064ec927e491096f817c0045542a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:43.944924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.945704 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6a17bd6-c864-4f2f-bcb2-eaae36c06eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:43.947461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1102/2218] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:43 2022] DELETE /identity/v3/projects/d71064ec927e491096f817c0045542a3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:43.952642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:43.953144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:43.953261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:43.982401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:43.983680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.060645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1117/2219] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:44.068500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.069028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.069502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.097188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:44.104424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.113679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1103/2220] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:44.118103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.129212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038b34-c247-4154-8e12-788af8f081d4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.134009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.134615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.134894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.135168 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.135908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:44.136208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.137951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.140732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:44.159915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1118/2221] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:24:44.160159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.166700 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406440c-4f58-4ee6-b8fa-ca88a60f36d9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.171832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.172446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.172720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.172982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.173620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.175547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.211756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1104/2222] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:24:44.215704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.227072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f058d5-2322-4f0d-b8b8-d6f12ef5e384 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.314925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.316591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.316591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.316591 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.317008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.319309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7393-8261-4682-9b6b-095dcb3e3aab admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.353042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1119/2223] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:44.357701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.369561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10962266-342b-4664-bc1a-9c76c9c6057b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.369910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf734-0ba7-49b1-a66f-1e6c7f47bf40 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.370360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf734-0ba7-49b1-a66f-1e6c7f47bf40 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.371070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf734-0ba7-49b1-a66f-1e6c7f47bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.374431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.375142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.375524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.375868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.376587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.378259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.394501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1105/2224] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:44.395655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.406589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49f92-e564-4080-83bc-35e5559401f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.412004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.412828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.414110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.414396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.415160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.415632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-00daf734-0ba7-49b1-a66f-1e6c7f47bf40 None None] MFA Rules not processed for user `fe48762436cd4f73868e4bcef2de333e`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:44.416910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00daf734-0ba7-49b1-a66f-1e6c7f47bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.417397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.432642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1106/2225] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:44.433772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.444141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398bf0-ac32-43da-b67c-bdd8f2704beb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.449291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.449973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.450292 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.450568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] PATH_INFO: `/v3/projects/327e0f8fea5f4cd0ab2381f8e96ee22c/users/caf8b5d933cc420ba23c70005dc5dcbd/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.473226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327e0f8fea5f4cd0ab2381f8e96ee22c, user_id=caf8b5d933cc420ba23c70005dc5dcbd, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.475973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0541-011b-440d-bc86-7e66b5acd101 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.495678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1107/2226] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:44 2022] PUT /identity/v3/projects/327e0f8fea5f4cd0ab2381f8e96ee22c/users/caf8b5d933cc420ba23c70005dc5dcbd/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:44.507221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.507610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.507955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.532167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1120/2227] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:44.541499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] MFA Rules not processed for user `caf8b5d933cc420ba23c70005dc5dcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:44.542679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.542806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.542960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.543260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.563981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] MFA Rules not processed for user `d3ef9ac05abc40fd868c471442243924`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:44.565305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.602133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:44.624598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1108/2228] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:44.629243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1121/2229] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:44.635364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.637105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.640410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:44.641906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.662451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:44.718874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946438e-495f-4325-887c-1788b09e1f39 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.725615 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.726021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8dde1-234e-40b7-8064-20ac3d0d4c11 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:44.726531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.727015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.727511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.732065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:44.732677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:44.732950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:44.733217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:44.735019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:44.742529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.745979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0d7aa-e062-42af-b1fa-190d288cf763 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.748314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:44.750005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:44.762701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1109/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:44.765321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1122/2231] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:24:53.606300 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee528e4-f397-4fe8-a2cf-bdfdd9793356 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:53.606811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee528e4-f397-4fe8-a2cf-bdfdd9793356 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:53.606811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee528e4-f397-4fe8-a2cf-bdfdd9793356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:53.627379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9ee528e4-f397-4fe8-a2cf-bdfdd9793356 None None] MFA Rules not processed for user `33ed9d37c5df4ab98a2f8a4f884952c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:53.628789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ee528e4-f397-4fe8-a2cf-bdfdd9793356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:53.689836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1110/2232] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:54.756006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=27 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:55.164492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:55.241552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1bdd-a171-4b4c-9823-ca6995ef578d service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:55.249009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:55.249661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:55.250583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:55.250583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] PATH_INFO: `/v3/users/caf8b5d933cc420ba23c70005dc5dcbd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:55.251580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf8b5d933cc420ba23c70005dc5dcbd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:55.253718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:55.315267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf8b5d933cc420ba23c70005dc5dcbd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:55.332125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf8b5d933cc420ba23c70005dc5dcbd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:55.342911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf8b5d933cc420ba23c70005dc5dcbd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:55.343913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf8b5d933cc420ba23c70005dc5dcbd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:55.344696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf8b5d933cc420ba23c70005dc5dcbd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:55.360061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1123/2233] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:24:55 2022] DELETE /identity/v3/users/caf8b5d933cc420ba23c70005dc5dcbd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:24:55.364360 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:55.364827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:55.365060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:55.384817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:55.386065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:55.445474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1111/2234] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:55.455669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:55.457259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:55.523072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7496-ee0d-493a-ae80-386b7a066fc6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:55.527087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:55.527730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:55.528008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:55.528278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:55.538085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:55.539593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9fe0b-65cd-4907-b4dd-f9373bfae1e0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:55.549380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1124/2235] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:24:56.016467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.018071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:56.050141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09f77-67c8-41dc-901e-8d343e372d8e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.055768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.056526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.057837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.058212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] PATH_INFO: `/v3/projects/327e0f8fea5f4cd0ab2381f8e96ee22c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.059559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=327e0f8fea5f4cd0ab2381f8e96ee22c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.061713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.117648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:56.131187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327e0f8fea5f4cd0ab2381f8e96ee22c', 'request_id': 'req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:56.140162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327e0f8fea5f4cd0ab2381f8e96ee22c', 'request_id': 'req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:56.148382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327e0f8fea5f4cd0ab2381f8e96ee22c', 'request_id': 'req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:56.161667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] The token cache is being invalidate because project 327e0f8fea5f4cd0ab2381f8e96ee22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:24:56.162039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:56.163082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea114f2a-6af3-40f1-8e9c-0bf9e716a79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:24:56.165018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1112/2236] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:24:56 2022] DELETE /identity/v3/projects/327e0f8fea5f4cd0ab2381f8e96ee22c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:56.170722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.171217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.171311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.203066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:56.204359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:56.229442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:24:56.306661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1125/2237] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:56.315533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b3615-083b-4033-84db-b282a8932e8a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.316023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b3615-083b-4033-84db-b282a8932e8a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.316228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b3615-083b-4033-84db-b282a8932e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.351836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-039b3615-083b-4033-84db-b282a8932e8a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:56.353671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-039b3615-083b-4033-84db-b282a8932e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:56.363245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1113/2238] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:24:56.367797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.380645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b3a3-7288-4390-ac43-eea0325b68d1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.386283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.387004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.387375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.387978 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.388627 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:24:56.389005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.390688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.406466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1126/2239] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:24:56.411098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b3615-083b-4033-84db-b282a8932e8a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.422901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b3615-083b-4033-84db-b282a8932e8a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.428329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.429212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.429574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.429935 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.430588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.433086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.467778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1114/2240] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:24:56 2022] POST /identity/v3/projects => generated 395 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:56.470231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.486736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd17d-0efb-4830-865a-bf9bf520a6a8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.587283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.588121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.588479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.589138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.589842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.592242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.619047 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1127/2241] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:24:56 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:24:56.624656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.635366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05cc3-e727-4ffc-97b0-334ba3bddc4b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.640333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.641255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.641529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.641954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.642600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.644231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.655659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1115/2242] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:56.660038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.670777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858f124-b437-4350-ada0-0de8b5a45fda admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.676592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.677286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.677620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.677996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.678680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.680437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07c553-614f-4089-90bb-7decbe86a395 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.692918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1128/2243] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:24:56.697367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.710394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b7cb9-9775-4f51-8399-ea478daa86c6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.715747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.716430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.716709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.717118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] PATH_INFO: `/v3/projects/df9a9216c14f4a7cba244f856b1cf093/users/f99b7d2b0d624617a338bab1aa9bf004/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.739576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9a9216c14f4a7cba244f856b1cf093, user_id=f99b7d2b0d624617a338bab1aa9bf004, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:56.744008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:56.762450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1116/2244] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:24:56 2022] PUT /identity/v3/projects/df9a9216c14f4a7cba244f856b1cf093/users/f99b7d2b0d624617a338bab1aa9bf004/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:24:56.775444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.776454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.776859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:56.812979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] MFA Rules not processed for user `f99b7d2b0d624617a338bab1aa9bf004`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:24:56.815496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:56.901681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1129/2245] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:24:56.916997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:24:56.919064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:24:56.992800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639fb85-512f-4c84-b400-920be530d89b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:24:56.997304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:24:56.997924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:24:56.998200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:24:56.998470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:24:57.008520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:24:57.010349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f326432-4a10-4011-9c29-f3e90f0b8766 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:24:57.021605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1117/2246] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:24:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:02.425055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:02.448288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:02.505189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac3a2-9b7d-4fa3-84d7-9329e9a69e20 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:02.509768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:02.510479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:02.510776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:02.511035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] PATH_INFO: `/v3/users/f99b7d2b0d624617a338bab1aa9bf004` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:02.512183 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99b7d2b0d624617a338bab1aa9bf004)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:02.514172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:02.563884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99b7d2b0d624617a338bab1aa9bf004'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:02.577379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99b7d2b0d624617a338bab1aa9bf004'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:02.584865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99b7d2b0d624617a338bab1aa9bf004'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:02.585577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99b7d2b0d624617a338bab1aa9bf004'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:02.586218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99b7d2b0d624617a338bab1aa9bf004'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:02.601695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1130/2247] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:02 2022] DELETE /identity/v3/users/f99b7d2b0d624617a338bab1aa9bf004 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:25:02.607491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:02.607943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:02.608033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:02.632754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:02.634025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:02.697044 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1118/2248] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:25:02.707684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:02.709360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:02.771588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b36c0-cae9-4447-8dd0-d6fbfd7f46c9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:02.775495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:02.776118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:02.776416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:02.776660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:02.786301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:02.787929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd880d-a849-4f4f-bb85-574ed93d183a service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:02.798578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1131/2249] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:03.127091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.129271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.138247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:03.153050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a1b7-177b-4bd6-be18-2987f0f3dd75 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.159011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.159856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.160383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.160718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] PATH_INFO: `/v3/projects/df9a9216c14f4a7cba244f856b1cf093` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.162109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9a9216c14f4a7cba244f856b1cf093)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.164272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.242829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9a9216c14f4a7cba244f856b1cf093', 'request_id': 'req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:03.253288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9a9216c14f4a7cba244f856b1cf093', 'request_id': 'req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:03.260911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9a9216c14f4a7cba244f856b1cf093', 'request_id': 'req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:03.275494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] The token cache is being invalidate because project df9a9216c14f4a7cba244f856b1cf093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:03.275999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:03.277424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e593b8b8-7f1a-4f9f-a2fc-beea6c8b7693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:03.279747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1119/2250] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:03 2022] DELETE /identity/v3/projects/df9a9216c14f4a7cba244f856b1cf093 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:03.285525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.285776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.286076 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.328270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:03.329612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.375865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:03.409596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1132/2251] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:03.417616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.417908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.418190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.446746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.448297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.451440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:03.452792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.489653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1120/2252] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:03.490580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.505346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31af79-2401-4185-960e-5468a83d8dc1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.514998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.515659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.515936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.516206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.516869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:25:03.517172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.518786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.536457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1121/2253] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:25:03.544956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.547992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb780e-96e0-4ed0-b19d-6ba009102c10 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.553652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.554402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.554749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.555501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.557909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.565805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ee93-8fc2-4539-af8a-30ddb0b22001 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.573495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.573495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.573918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.573918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.574682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.577351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.625318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1122/2254] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:25:03.629674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.649514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.653894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.667526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1133/2255] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:03.727512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803011b6-d63e-44bc-9bb6-934edfd235de admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.732759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.733539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.733988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.734394 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.735258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.737566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.765345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1123/2256] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:03 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:03.772558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.783577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1fdcd-7ed2-4215-96f6-44167ea03a19 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.788861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.789694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.790009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.790387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.790965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.793170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.804814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1134/2257] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:03.809062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.819478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae6c78-3097-4642-aad5-81f049f649e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.826519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.828314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.828608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.828882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.829680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.831996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d991-3204-4af6-9b1f-cd612663b72c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.849069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1124/2258] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:25:03.850383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:03.861983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3b40-6c76-4d5d-80db-c4d8f3b88c97 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:03.867141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:03.867870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.868143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.868410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] PATH_INFO: `/v3/projects/20f66f4da37a47218cd75c4c6892dc2e/users/de8f6838db6145de9827c515a24ce7fd/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.886209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f66f4da37a47218cd75c4c6892dc2e, user_id=de8f6838db6145de9827c515a24ce7fd, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:03.888902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:03.904829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1135/2259] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:03 2022] PUT /identity/v3/projects/20f66f4da37a47218cd75c4c6892dc2e/users/de8f6838db6145de9827c515a24ce7fd/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:03.909856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:03.910139 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:03.910409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:03.930318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:03.931567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:03.950040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:03.999173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1125/2260] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:04.009177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:04.011402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:04.073813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d9b34-39d8-4ada-a581-b6d5235e3db3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:04.077686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:04.078305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:04.078629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:04.078923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:04.088235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:04.089717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6b79c-359a-43d6-b3c5-584b5b95f2f5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:04.093672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:04.100745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1136/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:07.179096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:07.182255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:07.211947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97908e-4c25-4aa6-8fe2-d14198e542a2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:07.223085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:07.226180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:07.229236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:07.229716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] PATH_INFO: `/v3/users/42ebda9374a24a0e8349e29e5eb9ba81` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:07.232923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ebda9374a24a0e8349e29e5eb9ba81)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:07.238736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:07.445225 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ebda9374a24a0e8349e29e5eb9ba81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:07.487361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ebda9374a24a0e8349e29e5eb9ba81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:07.504431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ebda9374a24a0e8349e29e5eb9ba81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:07.506055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ebda9374a24a0e8349e29e5eb9ba81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:07.547639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ebda9374a24a0e8349e29e5eb9ba81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:07.568656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:07.569548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:07.570123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:07.573398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1126/2262] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:07 2022] DELETE /identity/v3/users/42ebda9374a24a0e8349e29e5eb9ba81 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:07.611030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:07.612573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:07.709279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1137/2263] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:07.720234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:07.721716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:07.828887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88afdc5-e3bd-4a67-b3cb-ee5affe23c63 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:07.837284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:07.838541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:07.839471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:07.839768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:07.908782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:07.910279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd8c6b-468f-4bcf-ab06-36d7c4ddd3c8 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:07.938504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1127/2264] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:08.332652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.334983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:08.349860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a409d2-3528-4e10-9d46-db6659b174b8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.360444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:08.361254 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.361674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.362157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] PATH_INFO: `/v3/projects/ce0e6f94e4d7485aac4a0059d062eea7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.363712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0e6f94e4d7485aac4a0059d062eea7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:08.365839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:08.423295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0e6f94e4d7485aac4a0059d062eea7', 'request_id': 'req-fb3622c5-562f-4349-87f0-4e91a60c9db3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:08.430121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0e6f94e4d7485aac4a0059d062eea7', 'request_id': 'req-fb3622c5-562f-4349-87f0-4e91a60c9db3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:08.437058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0e6f94e4d7485aac4a0059d062eea7', 'request_id': 'req-fb3622c5-562f-4349-87f0-4e91a60c9db3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:08.474759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] The token cache is being invalidate because project ce0e6f94e4d7485aac4a0059d062eea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:08.475271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:08.476277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fb3622c5-562f-4349-87f0-4e91a60c9db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:08.478210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1138/2265] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:08 2022] DELETE /identity/v3/projects/ce0e6f94e4d7485aac4a0059d062eea7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:08.485213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.486708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.487014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.516851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:08.518082 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:08.561419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:08.616768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1128/2266] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:08.626678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.627230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.627230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.649728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:08.651765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:08.663236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1139/2267] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:08.664528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.676574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19f9d-a784-4e6d-b9d7-3f0e342e80e8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.685148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:08.685960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.686288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.686562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.687400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:25:08.687702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:08.689830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:08.711350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.711537 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1129/2268] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:25:08.722280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b23d4-3c19-4b1a-8a60-efcde17df932 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.727889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:08.728500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.728912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.729359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.730542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:08.732525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:08.765954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1140/2269] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:08 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:08.767516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.779759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa711-fff4-41ba-9a85-462b79f9f4ae admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.862816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:08.864167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.864552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.864896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.865616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:08.867944 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:08.903530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1130/2270] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:08 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:08.909081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.923387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc2d7-7b2a-4b1d-aa0d-0aa85787decf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.938941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:08.939849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:08.940290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:08.940712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:08.941538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:08.943410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:08.961122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1141/2271] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:08.966143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:08.982276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae5a1-69d7-4d16-b252-94550239ef1e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:08.996620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:09.002087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:09.002433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:09.002685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:09.003424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:09.005054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e520d8-ed38-44b7-9e9f-437403845327 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:09.018178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1131/2272] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:09.022676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:09.033917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813bf16-50ad-4f5e-900a-29fce834eda7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:09.041459 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:09.042277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:09.042663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:09.043037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] PATH_INFO: `/v3/projects/d0950a499c784e43b3ad13c5fc89cb1b/users/a0b7c788c7b14f0b8a88f0d9b6a80d70/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:09.070540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0950a499c784e43b3ad13c5fc89cb1b, user_id=a0b7c788c7b14f0b8a88f0d9b6a80d70, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:09.073860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:09.099429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1142/2273] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:09 2022] PUT /identity/v3/projects/d0950a499c784e43b3ad13c5fc89cb1b/users/a0b7c788c7b14f0b8a88f0d9b6a80d70/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:09.102952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92c75-aea9-42d7-a763-6ca92729b72a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:09.103319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92c75-aea9-42d7-a763-6ca92729b72a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:09.103585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92c75-aea9-42d7-a763-6ca92729b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:09.139132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1f92c75-aea9-42d7-a763-6ca92729b72a None None] MFA Rules not processed for user `a0b7c788c7b14f0b8a88f0d9b6a80d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:09.140404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1f92c75-aea9-42d7-a763-6ca92729b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:09.215508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1132/2274] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:09.227346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:09.229872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:09.262468 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:09.355430 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88c0c-0709-4bfe-a586-012a89534e50 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:09.359714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:09.360392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:09.360671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:09.360941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:09.371574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:09.373036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:09.382551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1143/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:10.150423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:10.151117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:10.151117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:10.200726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] MFA Rules not processed for user `de8f6838db6145de9827c515a24ce7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:10.201955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:10.234870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:10.349624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1133/2276] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:10.350878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:10.352390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:10.513960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e059b6-d7bc-41c7-aee3-9595d4d4ada4 service glance] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:10.524300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:10.525010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:10.525295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:10.525568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:10.526272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:10.528381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:10.584291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1144/2277] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:10 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:25:10.586437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:10.604898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60224-95f8-4c01-8af1-33d825550c2e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:10.712407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:10.713034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:10.713367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:10.713634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:10.714543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:10.716507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:10.770103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1134/2278] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:10 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:10.774069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:10.803320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5b45-8523-445c-8db0-8348682a3dc6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:10.819779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:10.819779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:10.819779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:10.824086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:10.830779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:10.831387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:10.851583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1145/2279] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:10.855718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:10.870310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f8f0-4939-4a2b-9401-d9530dd99bc9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:10.881364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:10.882077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:10.882357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:10.882629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] PATH_INFO: `/v3/projects/abec826c2e4f4ed6bc7060596f785625/users/1fd511ed44f44eb4a6aca8dea0a74ea7/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:10.906676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abec826c2e4f4ed6bc7060596f785625, user_id=1fd511ed44f44eb4a6aca8dea0a74ea7, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:10.909514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:10.935459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1135/2280] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:10 2022] PUT /identity/v3/projects/abec826c2e4f4ed6bc7060596f785625/users/1fd511ed44f44eb4a6aca8dea0a74ea7/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:25:10.939535 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:10.958117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dca23-8687-4878-9443-9e60f8a7b14a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:11.054773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:11.055478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:11.055751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:11.056013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:11.056656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:11.058714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e628a-d805-4246-b2a6-0f99b9c2c34a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:11.069765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1146/2281] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:25:11.074604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:11.086477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb8725-0b5c-4f47-bb19-2bcfc99d0787 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:11.096530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:11.097217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:11.097499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:11.097771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] PATH_INFO: `/v3/projects/abec826c2e4f4ed6bc7060596f785625/users/1fd511ed44f44eb4a6aca8dea0a74ea7/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:11.099802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abec826c2e4f4ed6bc7060596f785625, user_id=1fd511ed44f44eb4a6aca8dea0a74ea7, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:11.102978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:11.114854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1136/2282] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:11 2022] PUT /identity/v3/projects/abec826c2e4f4ed6bc7060596f785625/users/1fd511ed44f44eb4a6aca8dea0a74ea7/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:14.832344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca004-7cf3-4868-b83a-b801f53cc699 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:14.832865 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca004-7cf3-4868-b83a-b801f53cc699 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:14.833447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca004-7cf3-4868-b83a-b801f53cc699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:14.872288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4a7ca004-7cf3-4868-b83a-b801f53cc699 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:14.876552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4a7ca004-7cf3-4868-b83a-b801f53cc699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:14.934990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:14.972374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1147/2283] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:14.985637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:14.987848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:15.150186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d0b8-7a50-4727-8ee4-e4c64ef2e59c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:15.157801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:15.158897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:15.159163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:15.159604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:15.176174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:15.179254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:15.217906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1137/2284] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:18.959367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb565-6f86-4993-ae8f-a6704f662a47 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:18.960527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb565-6f86-4993-ae8f-a6704f662a47 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:18.961569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb565-6f86-4993-ae8f-a6704f662a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:19.034297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e26fb565-6f86-4993-ae8f-a6704f662a47 None None] MFA Rules not processed for user `1fd511ed44f44eb4a6aca8dea0a74ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:19.036027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e26fb565-6f86-4993-ae8f-a6704f662a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:19.219940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1148/2285] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:25.204012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:25.841510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:25.843090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:26.009769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dbb9e-0499-4a24-9607-ecffd66abf3d service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:26.024429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:26.025071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:26.025470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:26.026622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:26.164113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:26.166030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:26.193936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1138/2286] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:26.506563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb670-5d08-4c06-baab-6189e7da6e8d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:26.508637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb670-5d08-4c06-baab-6189e7da6e8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:26.509743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb670-5d08-4c06-baab-6189e7da6e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:26.560185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-415bb670-5d08-4c06-baab-6189e7da6e8d None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:26.586935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-415bb670-5d08-4c06-baab-6189e7da6e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:26.656312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:26.690973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1149/2287] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:26.708798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f1fc-2573-4d5b-8069-a2f547238723 service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:26.718443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:26.722923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:26.722923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:26.724901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:26.758211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f858-d8c9-4282-9f93-d663f606c677 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:26.758777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f858-d8c9-4282-9f93-d663f606c677 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:26.759332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f858-d8c9-4282-9f93-d663f606c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:26.766307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:26.768135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7197955-bbee-4624-8925-957dc0694231 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:26.796919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ee37f858-d8c9-4282-9f93-d663f606c677 None None] MFA Rules not processed for user `e6530474477c4d20966d1cacc379ed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:26.798564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ee37f858-d8c9-4282-9f93-d663f606c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:26.800193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1139/2288] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:26.895605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1150/2289] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:29.866754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:29.867404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:29.867404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:29.869392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1140/2290] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:25:29.905628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410792-719d-4d74-93b5-769c6053914a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:29.906754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410792-719d-4d74-93b5-769c6053914a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:29.907188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3410792-719d-4d74-93b5-769c6053914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:29.969094 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b3410792-719d-4d74-93b5-769c6053914a None None] MFA Rules not processed for user `8f966288c77849f1b591bd3fc8fbd8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:29.970421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3410792-719d-4d74-93b5-769c6053914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:30.161620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:30.249330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1151/2291] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:25:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:25:30.283917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:30.287808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:30.335315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f749-b70c-4228-9df3-63ac25ac6e23 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:30.345854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:30.346628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:30.346906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:30.347178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:30.367253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:30.367253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:30.373950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1141/2292] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:31.249070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3410792-719d-4d74-93b5-769c6053914a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:31.251968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3410792-719d-4d74-93b5-769c6053914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:31.431292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3410792-719d-4d74-93b5-769c6053914a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:31.437845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:31.438853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:31.439486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:31.440125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] PATH_INFO: `/v3/users/d3ef9ac05abc40fd868c471442243924` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:31.442617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ef9ac05abc40fd868c471442243924)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:31.444706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:31.567298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ef9ac05abc40fd868c471442243924'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:31.615180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ef9ac05abc40fd868c471442243924'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:31.626845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ef9ac05abc40fd868c471442243924'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:31.627629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ef9ac05abc40fd868c471442243924'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:31.628916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ef9ac05abc40fd868c471442243924'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:31.668467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1152/2293] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:31 2022] DELETE /identity/v3/users/d3ef9ac05abc40fd868c471442243924 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:31.905780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:31.928917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696a006-03e7-410c-984f-736f6c6afb02 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:32.073888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:32.074938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:32.075473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:32.077556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] PATH_INFO: `/v3/projects/d2d3c472e8034fbda0a4e180c01fa7b0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:32.079056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d3c472e8034fbda0a4e180c01fa7b0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:32.086799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:32.151460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:32.183182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d3c472e8034fbda0a4e180c01fa7b0', 'request_id': 'req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.201865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d3c472e8034fbda0a4e180c01fa7b0', 'request_id': 'req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.221342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d3c472e8034fbda0a4e180c01fa7b0', 'request_id': 'req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.243136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] The token cache is being invalidate because project d2d3c472e8034fbda0a4e180c01fa7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:32.245061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.246304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.251639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1142/2294] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:31 2022] DELETE /identity/v3/projects/d2d3c472e8034fbda0a4e180c01fa7b0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:32.252451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:32.253921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:32.285988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8fca-e116-4b30-91b5-5c7cf6819c93 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:32.425331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:32.425710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:32.426009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:32.426279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] PATH_INFO: `/v3/users/fe48762436cd4f73868e4bcef2de333e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:32.433089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe48762436cd4f73868e4bcef2de333e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:32.435065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:32.477680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:32.522881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe48762436cd4f73868e4bcef2de333e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.548848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe48762436cd4f73868e4bcef2de333e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.580986 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe48762436cd4f73868e4bcef2de333e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.582037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe48762436cd4f73868e4bcef2de333e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.582829 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3d7c451e-d391-4818-975d-84f2a0683bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe48762436cd4f73868e4bcef2de333e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:32.608650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1153/2295] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:32 2022] DELETE /identity/v3/users/fe48762436cd4f73868e4bcef2de333e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:25:33.432982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:33.434657 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:33.479792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cdf4-e6e7-4dc3-8a92-704a396574e1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:33.616000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:33.616912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:33.620784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:33.621452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] PATH_INFO: `/v3/projects/eb056c1c17934900bcda9b4a6af63e29` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:33.624070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb056c1c17934900bcda9b4a6af63e29)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:33.627947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:33.718709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb056c1c17934900bcda9b4a6af63e29', 'request_id': 'req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:33.728855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb056c1c17934900bcda9b4a6af63e29', 'request_id': 'req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:33.741141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb056c1c17934900bcda9b4a6af63e29', 'request_id': 'req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:33.762362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] The token cache is being invalidate because project eb056c1c17934900bcda9b4a6af63e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:33.762837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:33.763639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-71ecfab4-f6f8-4f54-b008-713b7d8f83a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:33.768709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1143/2296] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:33 2022] DELETE /identity/v3/projects/eb056c1c17934900bcda9b4a6af63e29 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:33.770271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:33.770785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:33.770785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:33.842687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:33.842687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:33.916864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1154/2297] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:33.926181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:33.926555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:33.926949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:33.967094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:33.968472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:33.994576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1144/2298] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:33.998913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.017748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79f1c-1f1a-4a81-9199-6a22f802de38 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.025914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.026631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.026989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.027481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.028213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:25:34.028578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.030950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.045562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1155/2299] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:25:34.053351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.066940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca399fa6-a334-4328-8b9b-72c1e5b1d929 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.072455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.073653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.076177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.076539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.077523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.079846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.149049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1145/2300] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:34 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:34.153217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.164349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209df1e-56c7-4f79-ba16-7b9c2e23e282 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.233203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.233836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.234113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.234401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.235041 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.237032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.265603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1156/2301] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:34 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:25:34.274170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.292810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495863-9582-4d28-9fc2-19b3b6f54a6d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.304857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.309823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.310431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.313246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.314626 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.316558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.337256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1146/2302] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:34.341400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.361272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5695-b5c4-48e8-9ee5-86bf188dda4f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.373300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.373990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.374275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.374552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.375293 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.377234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290fbd7-0025-44ae-8894-3346cf2c62d2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.383904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:34.405000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1157/2303] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:34.406213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.427260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54a94-cc94-4eeb-b14f-21f06f76f06b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.442472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.446315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.446927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.448216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] PATH_INFO: `/v3/projects/85863c74012a462eae46e5691c8e65b3/users/44795849202b4300b6c351ef83e5abeb/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.484737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:34.518931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85863c74012a462eae46e5691c8e65b3, user_id=44795849202b4300b6c351ef83e5abeb, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.522452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.555887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1147/2304] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:34 2022] PUT /identity/v3/projects/85863c74012a462eae46e5691c8e65b3/users/44795849202b4300b6c351ef83e5abeb/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:25:34.567028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.567376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.567643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.617599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] MFA Rules not processed for user `44795849202b4300b6c351ef83e5abeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:34.619803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:34.748554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1158/2305] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:34.760810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:34.762866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:34.842489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff363f-2d8f-4eab-ad42-b36afd884291 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:34.846961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:34.847728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:34.848345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:34.848854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:34.861166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:34.862775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf708-ac7f-4df9-864e-ced4562a521c service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:34.887435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1148/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:34.904793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:35.017960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fb081-7827-4fea-88d9-16555d728c59 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:35.023283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:35.023943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:35.024219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:35.024624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] PATH_INFO: `/v3/users/44795849202b4300b6c351ef83e5abeb` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:35.025867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44795849202b4300b6c351ef83e5abeb)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:35.027828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:35.108919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44795849202b4300b6c351ef83e5abeb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:35.150049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44795849202b4300b6c351ef83e5abeb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:35.172767 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44795849202b4300b6c351ef83e5abeb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:35.173522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44795849202b4300b6c351ef83e5abeb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:35.175642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44795849202b4300b6c351ef83e5abeb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:35.219539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1159/2307] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:34 2022] DELETE /identity/v3/users/44795849202b4300b6c351ef83e5abeb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:35.223314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:35.223612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:35.223880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:35.263404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:35.264906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:35.382413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1149/2308] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:35.389975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:35.391870 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:35.408387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:35.488936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee8f4f-15b5-44fd-b8de-58626821489b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:35.496744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:35.501388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:35.501711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:35.502101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:35.517536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:35.526345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e4f29-b812-49a1-87b6-f69196138bb5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:35.545392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1160/2309] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:36.034157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:36.035684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:36.067647 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791ec7-7f62-4570-8967-9eb76435ee7d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:36.081853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:36.082519 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.082801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.083075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] PATH_INFO: `/v3/projects/85863c74012a462eae46e5691c8e65b3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.087509 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85863c74012a462eae46e5691c8e65b3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:36.090307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:36.185623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85863c74012a462eae46e5691c8e65b3', 'request_id': 'req-caa2b990-09ea-42bf-a92f-fc8eb20a474c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:36.200399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85863c74012a462eae46e5691c8e65b3', 'request_id': 'req-caa2b990-09ea-42bf-a92f-fc8eb20a474c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:36.210494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85863c74012a462eae46e5691c8e65b3', 'request_id': 'req-caa2b990-09ea-42bf-a92f-fc8eb20a474c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:36.228278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] The token cache is being invalidate because project 85863c74012a462eae46e5691c8e65b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:36.230032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:36.232397 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-caa2b990-09ea-42bf-a92f-fc8eb20a474c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:36.238882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1150/2310] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:36 2022] DELETE /identity/v3/projects/85863c74012a462eae46e5691c8e65b3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:36.241101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.241586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.242004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.278021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:36.279449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:36.435883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1161/2311] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:36.441309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.441853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.442311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.489756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:36.491146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:36.535895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1151/2312] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:36.537346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:36.556723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab6b91-d1c6-45ab-955d-5047f3cf06c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:36.568368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:36.569005 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.569288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.569556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.570210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:25:36.570514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:36.572291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:36.591823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1162/2313] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:25:36.596286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:36.604599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:36.611191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ead6-c61b-44d0-804f-b939cc863c73 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:36.619900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:36.620550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.620812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.621081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.621726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:36.623774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:36.666724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1152/2314] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:36.668290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:36.681619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96f30-353f-4f4c-b0b9-bd3bc2d086fa admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:36.769665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:36.770810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.771325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.771899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.772759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:36.775118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:36.816569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1163/2315] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:36 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:36.820251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:36.893582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08387e9-94f1-42fc-85d1-36c6a38862bf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:36.951649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:36.953787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:36.953787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:36.953787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:36.953787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:36.955339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:36.978617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1153/2316] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:36.991691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:37.032431 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823212e-7d04-48fc-b18f-7c7f359bfd9e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:37.098884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:37.099936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:37.100385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:37.100826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:37.101695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:37.103709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c4ba1-3d9d-43eb-b639-160a6e424d54 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:37.171547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:37.173189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1164/2317] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:37.186544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640fe03-b9e7-4184-9c2e-519eba889bfb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:37.198857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:37.203409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:37.203972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:37.204420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] PATH_INFO: `/v3/projects/db4f5b9d3d4542dc8d805f678a79e87d/users/2d44c0cfc1c14ec6b4eb49281f9f47fc/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:37.266223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4f5b9d3d4542dc8d805f678a79e87d, user_id=2d44c0cfc1c14ec6b4eb49281f9f47fc, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:37.280836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:37.376739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1154/2318] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:37 2022] PUT /identity/v3/projects/db4f5b9d3d4542dc8d805f678a79e87d/users/2d44c0cfc1c14ec6b4eb49281f9f47fc/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:37.387736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acbbc-61c4-4f61-9d7d-70adfc2da75f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:37.388797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acbbc-61c4-4f61-9d7d-70adfc2da75f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:37.389237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acbbc-61c4-4f61-9d7d-70adfc2da75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:37.423571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dd6acbbc-61c4-4f61-9d7d-70adfc2da75f None None] MFA Rules not processed for user `2d44c0cfc1c14ec6b4eb49281f9f47fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:37.425354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dd6acbbc-61c4-4f61-9d7d-70adfc2da75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:37.430455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:37.535989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1165/2319] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:37.548505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:37.550504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:37.644717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954e72-2329-429e-aac6-3b1074b86114 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:37.648767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:37.649549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:37.650023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:37.650374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:37.662906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:37.664586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e753b-da72-401b-9cdb-f51ccb72a5df service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:37.678017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1155/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:38.555486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:38.555486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:38.555486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:38.581791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] MFA Rules not processed for user `de8f6838db6145de9827c515a24ce7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:38.583489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:38.671622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1166/2321] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:38.798027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59133918-9dbd-4d7f-ad83-d899937661f6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:38.798573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59133918-9dbd-4d7f-ad83-d899937661f6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:38.798768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59133918-9dbd-4d7f-ad83-d899937661f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:38.819673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-59133918-9dbd-4d7f-ad83-d899937661f6 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:38.821161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59133918-9dbd-4d7f-ad83-d899937661f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:38.892747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1156/2322] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:38.907598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:38.910141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:38.985953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36d77-4365-489c-8cbd-7b03c1b62e8e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:38.991361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:38.992055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:38.992380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:38.992708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:39.001762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:39.003538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:39.011909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1167/2323] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:39.727685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788d02f-a988-4e5f-8b4c-f61def7ccdd8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:39.728382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788d02f-a988-4e5f-8b4c-f61def7ccdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:39.728885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788d02f-a988-4e5f-8b4c-f61def7ccdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:39.757770 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8788d02f-a988-4e5f-8b4c-f61def7ccdd8 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:39.759879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8788d02f-a988-4e5f-8b4c-f61def7ccdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:39.788974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1157/2324] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:39.850081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:39.861461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff84b0-4282-4aa8-8e46-3791592c9799 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:39.880357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:39.881510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:39.882013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:39.882592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:39.898260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:39.900484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:39.922505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1168/2325] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:42.853134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:42.853609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:42.853734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:42.892086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:42.894091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:42.916694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1158/2326] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:25:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:42.924112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:42.944861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7869-990d-42e8-85a5-e0f32c332fbb service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:42.965071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:42.966110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:42.966546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:42.966968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:42.992725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:43.000689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:43.011170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1169/2327] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:25:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:25:43.671946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:43.673562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:43.789034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:43.831866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3264366-db2a-4c12-b231-d0c526fb5bf0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:43.839093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:43.839861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:43.840093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:43.840367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] PATH_INFO: `/v3/users/33ed9d37c5df4ab98a2f8a4f884952c8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:43.841562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ed9d37c5df4ab98a2f8a4f884952c8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:43.845237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:43.962317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ed9d37c5df4ab98a2f8a4f884952c8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:43.987851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ed9d37c5df4ab98a2f8a4f884952c8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.012318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ed9d37c5df4ab98a2f8a4f884952c8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.013577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ed9d37c5df4ab98a2f8a4f884952c8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.057406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-66a8b5ad-e7a1-4cc2-bba5-92c137ddb767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ed9d37c5df4ab98a2f8a4f884952c8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.074945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1159/2328] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:43 2022] DELETE /identity/v3/users/33ed9d37c5df4ab98a2f8a4f884952c8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:44.304122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:44.325326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945f93-eef7-4e9f-9d7e-787e711bb2d2 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:44.400021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:44.560854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:44.561610 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:44.561957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:44.562465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] PATH_INFO: `/v3/users/2d44c0cfc1c14ec6b4eb49281f9f47fc` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:44.565473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d44c0cfc1c14ec6b4eb49281f9f47fc)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:44.569092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:44.704401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d44c0cfc1c14ec6b4eb49281f9f47fc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.761593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d44c0cfc1c14ec6b4eb49281f9f47fc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.809660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d44c0cfc1c14ec6b4eb49281f9f47fc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.812491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d44c0cfc1c14ec6b4eb49281f9f47fc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.816513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d44c0cfc1c14ec6b4eb49281f9f47fc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:44.851324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1170/2329] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:44 2022] DELETE /identity/v3/users/2d44c0cfc1c14ec6b4eb49281f9f47fc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:44.856986 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:44.857302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:44.857729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:44.915622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:44.947968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:45.224875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1160/2330] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:45.274032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:45.276259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:45.377169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953b09-6d02-4d5b-a7db-338964ef3ee2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:45.388685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:45.389758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:45.390268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:45.390669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:45.423531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:45.429118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:45.459018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1171/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:25:46.155317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:46.156997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:46.215596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0d3bb-2479-4dd9-b957-b1aab87ca783 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:46.233931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:46.234600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:46.234932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:46.235226 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] PATH_INFO: `/v3/projects/a037a47a127b40e09f30b177ef587a5a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:46.241813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a037a47a127b40e09f30b177ef587a5a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:46.246327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:46.402381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a037a47a127b40e09f30b177ef587a5a', 'request_id': 'req-2f4e6d68-7a76-4c60-b147-39a01828ee9c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:46.419447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a037a47a127b40e09f30b177ef587a5a', 'request_id': 'req-2f4e6d68-7a76-4c60-b147-39a01828ee9c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:46.421359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:46.428911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a037a47a127b40e09f30b177ef587a5a', 'request_id': 'req-2f4e6d68-7a76-4c60-b147-39a01828ee9c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:46.459293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] The token cache is being invalidate because project a037a47a127b40e09f30b177ef587a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:46.459878 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:46.463664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2f4e6d68-7a76-4c60-b147-39a01828ee9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:46.471230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1161/2332] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:46 2022] DELETE /identity/v3/projects/a037a47a127b40e09f30b177ef587a5a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:47.007033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:47.009024 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:47.074984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452da268-5a54-46ea-bebe-456e2fb4ed9b service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:47.195493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:47.266034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:47.266820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:47.267101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:47.267513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] PATH_INFO: `/v3/projects/db4f5b9d3d4542dc8d805f678a79e87d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:47.270828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4f5b9d3d4542dc8d805f678a79e87d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:47.274919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:47.423740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4f5b9d3d4542dc8d805f678a79e87d', 'request_id': 'req-bb652698-d704-471d-b919-2134dd3c34d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:47.440724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4f5b9d3d4542dc8d805f678a79e87d', 'request_id': 'req-bb652698-d704-471d-b919-2134dd3c34d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:47.449689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4f5b9d3d4542dc8d805f678a79e87d', 'request_id': 'req-bb652698-d704-471d-b919-2134dd3c34d4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:47.495747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] The token cache is being invalidate because project db4f5b9d3d4542dc8d805f678a79e87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:47.496044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:47.496859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb652698-d704-471d-b919-2134dd3c34d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:47.504251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:47.504834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:47.504834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:47.509224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1172/2333] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:47 2022] DELETE /identity/v3/projects/db4f5b9d3d4542dc8d805f678a79e87d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:47.533219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:47.534669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:47.622420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1162/2334] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:47.631619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:47.631973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:47.632257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:47.733231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:47.739009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:47.791157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1173/2335] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:47.816013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:47.826359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2974f-dc87-40e9-b70f-c1acab58ae65 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:47.831286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:47.831921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:47.832202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:47.832485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:47.833147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:25:47.833450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:47.835091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:47.855097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1163/2336] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:25:47.856249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:47.867244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a6ca-e0cf-4d82-b616-a19dad994b3a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:47.874403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:47.875029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:47.875338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:47.875608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:47.876242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:47.878213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:47.915728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1174/2337] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:25:47 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:25:47.923075 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:47.935324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71bbf8-69e3-4357-8c91-202554ee6021 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:48.044404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:48.045340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.045873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.046337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.047289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:48.049851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:48.084915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:48.085670 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1164/2338] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:25:47 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:25:48.099514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1380-7aac-48aa-a79d-a9d4489bc58b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:48.104777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:48.105420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.105836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.106110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.106950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:48.108921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:48.127814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:48.128078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1175/2339] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:25:48.142209 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f6f3-7e19-42d9-bd4e-7dba7801c40e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:48.163290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:48.163947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.165489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.165822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.166966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:48.172926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab71b0c-bdde-406e-b149-1b7cf8dd88ba admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:48.190835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1165/2340] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:25:48.195409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:48.218132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4a9c-225f-4aaf-9f4e-7b7aaa1d2582 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:48.234010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:48.234832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.235021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.235596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] PATH_INFO: `/v3/projects/1a21532088d04775a5066d3bef7d0f1c/users/94d8bcfa9b3640d58568be23d2348ce1/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.291743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a21532088d04775a5066d3bef7d0f1c, user_id=94d8bcfa9b3640d58568be23d2348ce1, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:48.296968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:48.343126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1176/2341] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:25:48 2022] PUT /identity/v3/projects/1a21532088d04775a5066d3bef7d0f1c/users/94d8bcfa9b3640d58568be23d2348ce1/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:48.354678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.354929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.355294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.453883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] MFA Rules not processed for user `94d8bcfa9b3640d58568be23d2348ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:48.456642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:48.535957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:48.582767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1166/2342] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:48.591806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:48.593741 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:48.680276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2c28-c2a1-4846-a702-cb9b0b93d1d2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:48.684879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:48.685740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:48.686197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:48.686908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:48.713248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:48.715112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec005d-4d9f-4952-b11d-80cbdfca3d7c service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:48.729726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1177/2343] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:25:53.355630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:53.356952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:53.478554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778cc9-fcaf-4c58-8229-434972b02a9e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:53.483595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:53.484386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:53.487759 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:53.488131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] PATH_INFO: `/v3/users/a0b7c788c7b14f0b8a88f0d9b6a80d70` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:53.489778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b7c788c7b14f0b8a88f0d9b6a80d70)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:53.492155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:53.594222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b7c788c7b14f0b8a88f0d9b6a80d70'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:53.609751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b7c788c7b14f0b8a88f0d9b6a80d70'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:53.629482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b7c788c7b14f0b8a88f0d9b6a80d70'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:53.631466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b7c788c7b14f0b8a88f0d9b6a80d70'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:53.666448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b7c788c7b14f0b8a88f0d9b6a80d70'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:53.674375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1167/2344] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:25:53 2022] DELETE /identity/v3/users/a0b7c788c7b14f0b8a88f0d9b6a80d70 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:25:53.681773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:53.682294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:53.682294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:53.702432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:25:53.711291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:25:53.713608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:53.825795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1178/2345] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:25:53.836945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:53.838522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:53.927786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe8228-4ccc-4afb-b059-b359af514d61 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:53.936278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:53.937205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:53.937531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:53.937806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:53.956379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:53.958424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f11ab-d682-43b1-a635-f684b2319e00 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:53.973335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1168/2346] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:25:54.342231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:25:54.343813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:25:54.359484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3eda-1b56-489a-92b3-febb7c0aedc8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:25:54.377790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:25:54.381132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:25:54.382445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:25:54.383608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] PATH_INFO: `/v3/projects/d0950a499c784e43b3ad13c5fc89cb1b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:25:54.387512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0950a499c784e43b3ad13c5fc89cb1b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:25:54.391238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:25:54.593778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0950a499c784e43b3ad13c5fc89cb1b', 'request_id': 'req-c27ef737-52f2-4197-a843-63264f2e7314'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:54.601426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0950a499c784e43b3ad13c5fc89cb1b', 'request_id': 'req-c27ef737-52f2-4197-a843-63264f2e7314'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:54.610645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0950a499c784e43b3ad13c5fc89cb1b', 'request_id': 'req-c27ef737-52f2-4197-a843-63264f2e7314'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:54.645596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] The token cache is being invalidate because project d0950a499c784e43b3ad13c5fc89cb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:25:54.645922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:54.653479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c27ef737-52f2-4197-a843-63264f2e7314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:25:54.658344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1179/2347] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:25:54 2022] DELETE /identity/v3/projects/d0950a499c784e43b3ad13c5fc89cb1b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:26:03.967356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:04.101117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.101469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.101818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.103709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1169/2348] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:26:04.110171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8e9-6de4-42c3-b20e-207af86e65ff None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.110727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8e9-6de4-42c3-b20e-207af86e65ff None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.110875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca8e9-6de4-42c3-b20e-207af86e65ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.131785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1eaca8e9-6de4-42c3-b20e-207af86e65ff None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:04.133004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1eaca8e9-6de4-42c3-b20e-207af86e65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:04.217114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1180/2349] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:26:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:04.230726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:04.233208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:04.298187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985b40-56a3-484a-9fb6-deb91894eaef None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:04.314879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:04.314879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.314879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.314879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.316692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:04.318143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202de415-23ef-4f31-ab25-e7c7d2b94648 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:04.332402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1170/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:26:04.420542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.420888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.421275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.422745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1181/2351] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:26:04.428165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b65709-3137-422a-98ad-a5b250680a43 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.428446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b65709-3137-422a-98ad-a5b250680a43 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.428718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b65709-3137-422a-98ad-a5b250680a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.451465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-50b65709-3137-422a-98ad-a5b250680a43 None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:04.452648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-50b65709-3137-422a-98ad-a5b250680a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:04.513681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1171/2352] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:26:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:04.525773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:04.527584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:04.542701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5ed5-647a-4c88-9e0f-051a5160437f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:04.546126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:04.546862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.547136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.547432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.559724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:04.559724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c89954-eaef-425b-b246-a91f53c030a4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:04.564982 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1182/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:04.658388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190680d0-4a42-4418-8873-a4ef9e18e24f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.658676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190680d0-4a42-4418-8873-a4ef9e18e24f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.658984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190680d0-4a42-4418-8873-a4ef9e18e24f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.660474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1172/2354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:26:04.667320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af877c0-314a-4ef2-8532-a8afe50495d7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.667603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af877c0-314a-4ef2-8532-a8afe50495d7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.667897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af877c0-314a-4ef2-8532-a8afe50495d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.688456 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3af877c0-314a-4ef2-8532-a8afe50495d7 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:04.689673 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3af877c0-314a-4ef2-8532-a8afe50495d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:04.701185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1183/2355] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:26:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:04.713313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190680d0-4a42-4418-8873-a4ef9e18e24f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:04.725528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190680d0-4a42-4418-8873-a4ef9e18e24f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:04.730900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:04.731552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:04.731824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:04.732102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:04.744242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:04.745707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:04.757240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1173/2356] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:07.572208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:07.572794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:07.573192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:07.581069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:07.595901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:07.598472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:07.659795 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1184/2357] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:26:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:07.673640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:07.675389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:07.756990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239d-2592-44fd-9523-15f68d27d1d3 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:07.764175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:07.764808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:07.765087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:07.765415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:07.774232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:07.775950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:07.785207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1174/2358] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:26:17.652787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=24 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:17.781440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:20.763612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:20.773818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f185bbd-855c-441e-bc0a-7b87e22086bb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:20.777712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:20.778407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:20.778681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:20.778945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:20.780852 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:20.848812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:20.850289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db52162-5034-4c38-b321-3f98fec87b58 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:20.861036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1185/2359] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:21.436650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:21.439168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:21.549527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1cfa-9e75-4b08-8600-8ac1786a2646 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:21.554517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:21.555166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:21.555793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:21.555793 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] PATH_INFO: `/v3/users/94d8bcfa9b3640d58568be23d2348ce1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:21.556905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d8bcfa9b3640d58568be23d2348ce1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:21.558850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:21.625788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d8bcfa9b3640d58568be23d2348ce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:21.635066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d8bcfa9b3640d58568be23d2348ce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:21.648259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d8bcfa9b3640d58568be23d2348ce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:21.649527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d8bcfa9b3640d58568be23d2348ce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:21.665372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d8bcfa9b3640d58568be23d2348ce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:21.672808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1175/2360] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:26:21 2022] DELETE /identity/v3/users/94d8bcfa9b3640d58568be23d2348ce1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:26:21.678368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:21.678651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:21.679569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:21.699235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:21.700446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:21.769513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1186/2361] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:26:21.782171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:21.784365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:21.870901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0a093-187d-49e6-beec-1d600e155db4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:21.875518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:21.876342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:21.876474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:21.876936 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:21.888122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:21.892665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242be315-274b-427a-8bc4-db0465a8957d service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:21.904905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1176/2362] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:22.366234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.367856 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:22.381223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d0bc-c3da-4a4c-b67f-30205614e733 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.386578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.387255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.387699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.387974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] PATH_INFO: `/v3/projects/1a21532088d04775a5066d3bef7d0f1c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.389175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a21532088d04775a5066d3bef7d0f1c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.391407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.452206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a21532088d04775a5066d3bef7d0f1c', 'request_id': 'req-2386ee77-4541-46ff-83dc-c0c60dec7885'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:22.459417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a21532088d04775a5066d3bef7d0f1c', 'request_id': 'req-2386ee77-4541-46ff-83dc-c0c60dec7885'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:22.477354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a21532088d04775a5066d3bef7d0f1c', 'request_id': 'req-2386ee77-4541-46ff-83dc-c0c60dec7885'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:22.493440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] The token cache is being invalidate because project 1a21532088d04775a5066d3bef7d0f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:26:22.493732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:22.494385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2386ee77-4541-46ff-83dc-c0c60dec7885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:26:22.495958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1187/2363] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:26:22 2022] DELETE /identity/v3/projects/1a21532088d04775a5066d3bef7d0f1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:26:22.501165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.502134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.502565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.528622 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:22.530112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:22.551571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:22.609167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1177/2364] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:22.616926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.617210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.617530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.638757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:22.640096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:22.648508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1188/2365] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:22.652741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.662695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69d959-e4b4-433e-a909-64e4425d3e09 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.667283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.667894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.668285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.668562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.669211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:26:22.669514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.671192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.683743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1178/2366] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:26:22.688271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.697598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4735af-e1b1-4258-9779-59a0b605d37f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.702638 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.703399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.703703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.703971 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.704674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.706660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.717174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:22.738016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1189/2367] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:26:22 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:26:22.742246 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.753278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d9db-80ca-4777-80a2-5d95f1b931bd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.813928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.814532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.814811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.815081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.815749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.818496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.843065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1179/2368] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:26:22 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:26:22.844421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.854913 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570fe7d-420c-4bee-b360-a3f0c17bdee0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.859791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.860448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.860791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.861474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.861796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.863557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.874465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1190/2369] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:26:22.879104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.892621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052746-7456-4970-a20a-856c14922708 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.897747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.898354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.899317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.899317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.899575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.901227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a992a-a2bf-4f8c-94e8-8fa9a05be923 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.913138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1180/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:26:22.917580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:22.931215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295cc2-bd90-4285-9257-52f3226b4759 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:22.937404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:22.938315 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.939016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.939348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] PATH_INFO: `/v3/projects/7e2f038164884e79892cf80e2c00f8d7/users/c11884b7e24b43c28150ff72992fd3e9/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:22.959074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2f038164884e79892cf80e2c00f8d7, user_id=c11884b7e24b43c28150ff72992fd3e9, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:22.963560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:22.981891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1191/2371] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:26:22 2022] PUT /identity/v3/projects/7e2f038164884e79892cf80e2c00f8d7/users/c11884b7e24b43c28150ff72992fd3e9/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:26:22.987452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:22.987739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:22.988163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:23.018736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:23.020088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:23.098532 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1181/2372] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:23.109619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:23.111446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:23.175853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084c1e9-f9bb-4e3f-bd42-cb2ce9ae1f7a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:23.179735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:23.180685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:23.181114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:23.181533 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:23.193204 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:23.194947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823554a-5374-47a6-be12-6f03439a8db5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:23.206189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1192/2373] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:24.071307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:24.072937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:24.159096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:24.206009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f14db-1467-46f7-9fdc-63ede9210411 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:24.214517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:24.215143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:24.215451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:24.215722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:24.219295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:24.235722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:24.237540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:24.253677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1182/2374] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:25.823632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d93346-ca51-4827-8b64-2bb935ed000d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:25.824708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d93346-ca51-4827-8b64-2bb935ed000d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:25.825127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d93346-ca51-4827-8b64-2bb935ed000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:25.848691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-31d93346-ca51-4827-8b64-2bb935ed000d None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:25.850337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-31d93346-ca51-4827-8b64-2bb935ed000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:25.936893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1193/2375] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:25.949107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:25.952461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:26.059022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9964f-35fb-49a6-919c-54a22ebd38e3 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:26.065028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:26.065671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:26.065991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:26.066264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:26.092913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:26.094507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:26.110140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1183/2376] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:26:28.611246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:28.611734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:28.611868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:28.646466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] MFA Rules not processed for user `c11884b7e24b43c28150ff72992fd3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:28.647722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:28.702309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:28.722170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1194/2377] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:26:28.726762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:28.737899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41ad5-0434-4583-86f4-9ced6295d2e9 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:28.743375 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:28.744013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:28.744293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:28.744697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:28.745269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:28.747239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:28.784495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1184/2378] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:26:28 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:26:28.786148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:28.814492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5d3f-709b-4a07-bc7f-4330a0026ce5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:28.881662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:28.882310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:28.882585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:28.883028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:28.883698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:28.885657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:28.912804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1195/2379] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:26:28 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:26:28.916693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:28.929743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649af-45df-4b77-8f9f-6db79b073e5d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:28.934719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:28.935379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:28.935654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:28.935917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:28.936616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:28.938350 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:28.949677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1185/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:26:28.954303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:28.964567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f303b4-e4cf-44d5-9653-cf639438e003 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:28.969233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:28.969902 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:28.970173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:28.970628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] PATH_INFO: `/v3/projects/9da8a99072004e94b1471c992d820e8d/users/0b347d7a769a465fabdc612f90aa5b56/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:28.987464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da8a99072004e94b1471c992d820e8d, user_id=0b347d7a769a465fabdc612f90aa5b56, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:28.990192 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:29.005693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1196/2381] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:26:28 2022] PUT /identity/v3/projects/9da8a99072004e94b1471c992d820e8d/users/0b347d7a769a465fabdc612f90aa5b56/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:26:29.009706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:29.021117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddd5b-7b80-4c73-a7c2-de049cae00b7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:29.084559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:29.085180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:29.085454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:29.085733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:29.086367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:29.088007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25342a3-2dbf-4062-962e-5c91eb60804c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:29.098741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1186/2382] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:26:29.102993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:29.113911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c123045-d6f8-4adc-8912-77be2d7e0cda admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:29.119641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:29.120334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:29.120654 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:29.120884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] PATH_INFO: `/v3/projects/9da8a99072004e94b1471c992d820e8d/users/0b347d7a769a465fabdc612f90aa5b56/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:29.123080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da8a99072004e94b1471c992d820e8d, user_id=0b347d7a769a465fabdc612f90aa5b56, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:29.125999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:29.138722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1197/2383] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:26:29 2022] PUT /identity/v3/projects/9da8a99072004e94b1471c992d820e8d/users/0b347d7a769a465fabdc612f90aa5b56/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:26:34.510892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf3da-2286-4f46-9666-2152b222cbe7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:34.511458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf3da-2286-4f46-9666-2152b222cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:34.511560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf3da-2286-4f46-9666-2152b222cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:34.535483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:34.548299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6c7cf3da-2286-4f46-9666-2152b222cbe7 None None] MFA Rules not processed for user `0b347d7a769a465fabdc612f90aa5b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:34.550329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6c7cf3da-2286-4f46-9666-2152b222cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:34.637949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1187/2384] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:34.655251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:26:34.657238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:34.739984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b256c3-0fb5-4947-b6f3-73fbe12cca6c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:26:34.746476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:26:34.747088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:34.747410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:34.747672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:34.790022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:34.809032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:26:34.810728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:26:34.820641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1198/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:26:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:26:35.969957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca6ec-0ac8-430e-971f-1e13a8db5066 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:26:35.970499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca6ec-0ac8-430e-971f-1e13a8db5066 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:26:35.970606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca6ec-0ac8-430e-971f-1e13a8db5066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:26:35.990908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1ceca6ec-0ac8-430e-971f-1e13a8db5066 None None] MFA Rules not processed for user `c11884b7e24b43c28150ff72992fd3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:26:35.992135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1ceca6ec-0ac8-430e-971f-1e13a8db5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:26:36.000503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1188/2386] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:26:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:26:44.816133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=9 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:26:45.985097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=32 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:04.404004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:27:04.405599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:27:04.468329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609213-2e27-484a-9bec-e09e5f16f1ba service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:27:04.472647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:27:04.473267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:04.473562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:04.473828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:04.484095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:27:04.485552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475686d2-16ad-4f27-a938-dffb4a4d1128 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:27:04.495937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1199/2387] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:27:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:27:14.492325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=26 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:15.247061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258792-a737-4728-8993-31eccfff36d2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:15.247828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258792-a737-4728-8993-31eccfff36d2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:15.247828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258792-a737-4728-8993-31eccfff36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:15.267465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-91258792-a737-4728-8993-31eccfff36d2 None None] MFA Rules not processed for user `e6530474477c4d20966d1cacc379ed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:27:15.268686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-91258792-a737-4728-8993-31eccfff36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:27:15.329406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1189/2388] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:27:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:27:18.599617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775d30-49c2-4ecd-af59-bfb841ab4702 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:18.600112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775d30-49c2-4ecd-af59-bfb841ab4702 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:18.600226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775d30-49c2-4ecd-af59-bfb841ab4702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:18.620670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-44775d30-49c2-4ecd-af59-bfb841ab4702 None None] MFA Rules not processed for user `ad165b2ffe474917b042bfa5d356366b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:27:18.621780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-44775d30-49c2-4ecd-af59-bfb841ab4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:27:18.680118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1200/2389] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:27:25.321968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:26.357665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:26.358284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:26.358284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:26.378286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] MFA Rules not processed for user `b9d14f46c717426fa7ed83a2664043fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:27:26.379544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:27:26.437503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1190/2390] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:27:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:27:28.673668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:36.430898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:27:55.489669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:55.490153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:55.490245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:55.511025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:27:55.512251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:27:55.572667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1201/2391] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:27:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:27:55.625479 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:27:55.700773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486f64f-d87a-490d-91de-d2fd7ca18dd0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:27:55.706901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:27:55.707544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:27:55.707820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:27:55.708088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:27:55.716577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:27:55.718190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:27:55.726356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1191/2392] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:28:02.848805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:02.850580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:02.925792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0d17b-8098-4a9f-a649-f15f1955364f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:02.930742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:02.931450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:02.931810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:02.932110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] PATH_INFO: `/v3/users/de8f6838db6145de9827c515a24ce7fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:02.933326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8f6838db6145de9827c515a24ce7fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:02.935463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:02.986941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8f6838db6145de9827c515a24ce7fd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:02.999968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8f6838db6145de9827c515a24ce7fd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.007361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8f6838db6145de9827c515a24ce7fd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.008134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8f6838db6145de9827c515a24ce7fd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.008772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8f6838db6145de9827c515a24ce7fd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.022579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1202/2393] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:02 2022] DELETE /identity/v3/users/de8f6838db6145de9827c515a24ce7fd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:03.210919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:03.223117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fd8cf-209a-479a-84e9-76b8a122fb37 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:03.282812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:03.283493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:03.283768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:03.284042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] PATH_INFO: `/v3/projects/20f66f4da37a47218cd75c4c6892dc2e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:03.285566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f66f4da37a47218cd75c4c6892dc2e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:03.287573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:03.340595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f66f4da37a47218cd75c4c6892dc2e', 'request_id': 'req-f8c5bd40-187c-40a9-8b72-a20c11703293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.351218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f66f4da37a47218cd75c4c6892dc2e', 'request_id': 'req-f8c5bd40-187c-40a9-8b72-a20c11703293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.357153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f66f4da37a47218cd75c4c6892dc2e', 'request_id': 'req-f8c5bd40-187c-40a9-8b72-a20c11703293'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.371744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] The token cache is being invalidate because project 20f66f4da37a47218cd75c4c6892dc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:03.372039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.372692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.374351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1192/2394] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:03 2022] DELETE /identity/v3/projects/20f66f4da37a47218cd75c4c6892dc2e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:03.379017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:03.380492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:03.401305 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf086-4f11-4d61-8baf-06e28c332a7f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:03.422340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:03.468816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:03.469745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:03.470019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:03.470289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] PATH_INFO: `/v3/users/1fd511ed44f44eb4a6aca8dea0a74ea7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:03.471566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd511ed44f44eb4a6aca8dea0a74ea7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:03.473649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:03.526712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd511ed44f44eb4a6aca8dea0a74ea7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.542171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd511ed44f44eb4a6aca8dea0a74ea7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.550275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd511ed44f44eb4a6aca8dea0a74ea7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.550990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd511ed44f44eb4a6aca8dea0a74ea7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.551602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd511ed44f44eb4a6aca8dea0a74ea7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.565363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1203/2395] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:03 2022] DELETE /identity/v3/users/1fd511ed44f44eb4a6aca8dea0a74ea7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:03.754753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:03.756364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:03.772920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5bd40-187c-40a9-8b72-a20c11703293 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:03.792371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:03.834816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:03.835480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:03.835758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:03.836026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] PATH_INFO: `/v3/projects/abec826c2e4f4ed6bc7060596f785625` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:03.837265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abec826c2e4f4ed6bc7060596f785625)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:03.839177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:03.890918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abec826c2e4f4ed6bc7060596f785625', 'request_id': 'req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.900066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abec826c2e4f4ed6bc7060596f785625', 'request_id': 'req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.905713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abec826c2e4f4ed6bc7060596f785625', 'request_id': 'req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.917069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] The token cache is being invalidate because project abec826c2e4f4ed6bc7060596f785625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:03.917362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.918019 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:03.919556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1193/2396] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:03 2022] DELETE /identity/v3/projects/abec826c2e4f4ed6bc7060596f785625 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:13.561946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:13.914085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:16.313949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:16.316643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:16.379976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466bbc8-69db-4ead-82e3-5e8c6de23eb8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:16.431215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:16.431841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:16.432112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:16.432374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:16.434251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:16.522524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:16.524040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:16.536118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1204/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:18.927347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:18.929369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:18.944473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2e852-a5f6-4b62-ac65-32d628f4f5d0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:18.948337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:18.948994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:18.949296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:18.949573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:18.951611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:18.967140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:18.968676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:18.981605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1194/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:21.302985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:21.304471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:21.315473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94351-6995-437e-aac6-b689096fc484 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:21.319625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:21.320240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:21.320505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:21.320774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:21.322541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:21.377663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:21.391395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:21.392925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:21.406962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1205/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:24.985123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:24.987175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:25.009720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328e01-05ff-4898-b684-b2ce46a8d2d1 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.015776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.017634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.018406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.019655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.022320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:25.118879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.122152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:25.134722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1195/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:25.195488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:25.197404 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:25.211376 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50c4c-27fe-453b-96e8-65e3a8d20590 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.221205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.222027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.222301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.222565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] PATH_INFO: `/v3/users/e6530474477c4d20966d1cacc379ed3b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.223799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6530474477c4d20966d1cacc379ed3b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.226002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:25.284477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6530474477c4d20966d1cacc379ed3b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.302356 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6530474477c4d20966d1cacc379ed3b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.311380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6530474477c4d20966d1cacc379ed3b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.312322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6530474477c4d20966d1cacc379ed3b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.312932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-685bf034-9042-46c1-bb88-2e23064e0c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6530474477c4d20966d1cacc379ed3b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.334955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1206/2401] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:25 2022] DELETE /identity/v3/users/e6530474477c4d20966d1cacc379ed3b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:25.514946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:25.527080 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1481b8-50dd-491c-956f-1fce82796a24 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.590348 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.590980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.591248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.591541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] PATH_INFO: `/v3/projects/dd2b4179f7e7414689bab00f12ef703d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.592706 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2b4179f7e7414689bab00f12ef703d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.594676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:25.644710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2b4179f7e7414689bab00f12ef703d', 'request_id': 'req-a6795057-96a1-4f25-8192-a1994c9eb9ce'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.653052 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2b4179f7e7414689bab00f12ef703d', 'request_id': 'req-a6795057-96a1-4f25-8192-a1994c9eb9ce'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.658963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2b4179f7e7414689bab00f12ef703d', 'request_id': 'req-a6795057-96a1-4f25-8192-a1994c9eb9ce'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.670992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] The token cache is being invalidate because project dd2b4179f7e7414689bab00f12ef703d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:25.671435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.672295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a6795057-96a1-4f25-8192-a1994c9eb9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:25.674176 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1196/2402] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:25 2022] DELETE /identity/v3/projects/dd2b4179f7e7414689bab00f12ef703d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:25.679152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.679560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.679812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.699152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:25.700377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:25.762815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1207/2403] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:25.771058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.771390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.771665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.792281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:25.793506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:25.803697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1197/2404] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:25.808181 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:25.820705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56b1c-7872-44f4-bd83-42a3e62af610 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.828394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.829206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.829543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.829805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.830624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:25.831015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.833668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:25.847079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1208/2405] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:25.851881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:25.862079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367636-23be-4fab-910d-c886d78ed931 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.867912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.868517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.868800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.869066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.869699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.871730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:25.877445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:25.902640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1198/2406] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:25 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:25.907016 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:25.917490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81769fe-288c-40ee-86c1-dda7837838c9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:25.965200 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:25.975974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:25.976620 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:25.977136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:25.977441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:25.978193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:25.980433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:26.007151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1209/2407] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:25 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:26.012891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:26.028540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50907c4-b610-4e39-b5ac-8666b13333b3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:26.036219 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:26.036838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:26.037116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:26.037386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:26.038048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:26.039710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:26.050200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1199/2408] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:26.054357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:26.064564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a91b59-d2b7-4444-8c01-d5415741a550 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:26.069793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:26.070384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:26.070657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:26.070921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:26.071590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:26.073195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24bcf-5d24-4d6a-90ae-b61ac62fbf4e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:26.084260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1210/2409] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:26.088865 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:26.102068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637aa64-6692-4c25-a9bc-5e94a45404af admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:26.111025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:26.112084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:26.112420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:26.112782 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] PATH_INFO: `/v3/projects/e44f9d70caa54135b09c741772586d46/users/caeff839e1ad47e1931f8ff7604690e7/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:26.131682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44f9d70caa54135b09c741772586d46, user_id=caeff839e1ad47e1931f8ff7604690e7, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:26.134418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:26.150174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1200/2410] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:26 2022] PUT /identity/v3/projects/e44f9d70caa54135b09c741772586d46/users/caeff839e1ad47e1931f8ff7604690e7/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:26.155671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a1d0-7a15-4a49-9be3-2d591b314150 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:26.155951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a1d0-7a15-4a49-9be3-2d591b314150 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:26.156237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a1d0-7a15-4a49-9be3-2d591b314150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:26.179039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-da13a1d0-7a15-4a49-9be3-2d591b314150 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:26.180333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-da13a1d0-7a15-4a49-9be3-2d591b314150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:26.243348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1211/2411] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:26.253167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:26.254948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:26.313236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9e7d1-a8c5-4dfe-a919-f2a2fe8c91fc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:26.317997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:26.318616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:26.318922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:26.319179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:26.329495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:26.331005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:26.341055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1201/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:27.035178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.035652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.036033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.064380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] MFA Rules not processed for user `caeff839e1ad47e1931f8ff7604690e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:27.066249 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:27.138269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1212/2413] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:27.143039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.153141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c61fc-5921-45e4-a281-ad3a27b01b05 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.158771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.159409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.159687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.159987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.160783 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.162715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.191643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1202/2414] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:27 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:27.196408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.208411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000aa4-48dc-49d4-837e-4dc1655a0618 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.267488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.268216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.268455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.268720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.269626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.271588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.279955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:27.295920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1213/2415] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:27 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:27.300157 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.310439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25309cc-ee31-4c36-bc80-74b148fcfcfd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.315109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.315729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.316004 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.316276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.316934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.318539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.329739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1203/2416] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:27.334969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.345155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca02bf1-c023-4908-848e-9d2ff6eb282a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.350338 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.351032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.351342 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.351609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] PATH_INFO: `/v3/projects/5b3935d111de4c2691cbb33c93af136e/users/9df63610cfeb4daaa413c6dbc5b5dcd2/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.367900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3935d111de4c2691cbb33c93af136e, user_id=9df63610cfeb4daaa413c6dbc5b5dcd2, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.370559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.389805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1214/2417] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:27 2022] PUT /identity/v3/projects/5b3935d111de4c2691cbb33c93af136e/users/9df63610cfeb4daaa413c6dbc5b5dcd2/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:27.396591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.408896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5653d7-92d6-460d-b119-e371006e0de6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.474568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.475189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.475494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.475768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.476406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.478005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0333bf-2442-4d9e-9e77-2a5a9d3e7394 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.488382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1204/2418] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:27.493020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:27.505422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec019c-f692-4587-b0c0-ad158559f295 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:27.511139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:27.511831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:27.512102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:27.512362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] PATH_INFO: `/v3/projects/5b3935d111de4c2691cbb33c93af136e/users/9df63610cfeb4daaa413c6dbc5b5dcd2/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:27.514405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3935d111de4c2691cbb33c93af136e, user_id=9df63610cfeb4daaa413c6dbc5b5dcd2, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:27.517086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:27.530143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1215/2419] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:27 2022] PUT /identity/v3/projects/5b3935d111de4c2691cbb33c93af136e/users/9df63610cfeb4daaa413c6dbc5b5dcd2/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:28.238903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:28.239864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:28.240231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:28.272035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] MFA Rules not processed for user `9df63610cfeb4daaa413c6dbc5b5dcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:28.273518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:28.279771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:28.354111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1205/2420] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:29.459881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:29.543089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749284-1655-4e0d-8ff4-ee5e47e14914 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:29.547728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:29.548387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:29.548659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:29.549050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] PATH_INFO: `/v3/users/caeff839e1ad47e1931f8ff7604690e7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:29.550297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caeff839e1ad47e1931f8ff7604690e7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:29.552289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:29.605962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caeff839e1ad47e1931f8ff7604690e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.619381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caeff839e1ad47e1931f8ff7604690e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.626328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caeff839e1ad47e1931f8ff7604690e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.627008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caeff839e1ad47e1931f8ff7604690e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.627858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caeff839e1ad47e1931f8ff7604690e7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.644393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1216/2421] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:29 2022] DELETE /identity/v3/users/caeff839e1ad47e1931f8ff7604690e7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:29.830930 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:29.845228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4aed2-de7a-46e4-b752-a39ef8e36832 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:29.905405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:29.906058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:29.906337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:29.906607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] PATH_INFO: `/v3/projects/e44f9d70caa54135b09c741772586d46` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:29.907800 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44f9d70caa54135b09c741772586d46)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:29.909808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:29.960702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44f9d70caa54135b09c741772586d46', 'request_id': 'req-25d9ab1a-2fda-4656-a4fa-668151a6db40'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.970159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44f9d70caa54135b09c741772586d46', 'request_id': 'req-25d9ab1a-2fda-4656-a4fa-668151a6db40'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.976042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44f9d70caa54135b09c741772586d46', 'request_id': 'req-25d9ab1a-2fda-4656-a4fa-668151a6db40'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.989825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] The token cache is being invalidate because project e44f9d70caa54135b09c741772586d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:29.990227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.990964 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:29.992885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1206/2422] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:29 2022] DELETE /identity/v3/projects/e44f9d70caa54135b09c741772586d46 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:29.996998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:29.998447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:30.012803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3843-5fba-4236-9271-0966063bbe44 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.044740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:30.077743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.078539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.078909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.079279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] PATH_INFO: `/v3/users/9df63610cfeb4daaa413c6dbc5b5dcd2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.080815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df63610cfeb4daaa413c6dbc5b5dcd2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.083040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.139054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df63610cfeb4daaa413c6dbc5b5dcd2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.152743 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df63610cfeb4daaa413c6dbc5b5dcd2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.160414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df63610cfeb4daaa413c6dbc5b5dcd2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.161070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df63610cfeb4daaa413c6dbc5b5dcd2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.161685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a2cc5a71-2111-4c8c-99e2-785d98209290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df63610cfeb4daaa413c6dbc5b5dcd2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.178415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1217/2423] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:29 2022] DELETE /identity/v3/users/9df63610cfeb4daaa413c6dbc5b5dcd2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:30.358492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.359960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:30.376081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ab1a-2fda-4656-a4fa-668151a6db40 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.408000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:30.436288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.436837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.437120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.437389 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] PATH_INFO: `/v3/projects/5b3935d111de4c2691cbb33c93af136e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.438520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3935d111de4c2691cbb33c93af136e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.440542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.492354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3935d111de4c2691cbb33c93af136e', 'request_id': 'req-d82d4aca-6603-4bd9-ad4a-07bea31befbf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.500881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3935d111de4c2691cbb33c93af136e', 'request_id': 'req-d82d4aca-6603-4bd9-ad4a-07bea31befbf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.506725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3935d111de4c2691cbb33c93af136e', 'request_id': 'req-d82d4aca-6603-4bd9-ad4a-07bea31befbf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.518711 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] The token cache is being invalidate because project 5b3935d111de4c2691cbb33c93af136e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:30.519109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.519991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d82d4aca-6603-4bd9-ad4a-07bea31befbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:30.521610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1207/2424] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:30 2022] DELETE /identity/v3/projects/5b3935d111de4c2691cbb33c93af136e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:30.526648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.527119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.527229 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.548889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:30.550286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:30.620207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1218/2425] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:30.622122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.622406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.622682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.643227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:30.644440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:30.658583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1208/2426] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:30.663174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.673582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18213f02-787b-4eb8-b9cb-6d83d2efc3d7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.684970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.685628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.685898 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.686175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.686880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:30.687118 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.688959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.701612 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1219/2427] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:30.706309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.716469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95dc5a-94e8-4a44-9566-4c202620c5d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.721709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.722311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.722610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.722880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.723544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.725476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.760136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1209/2428] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:30 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:30.764458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.774770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b64dc-bd41-465c-bb23-e30e103c5e5c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.810098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:30.838109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.838738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.839017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.839326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.839955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.842032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.870241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1220/2429] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:30 2022] POST /identity/v3/users => generated 278 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:30.874294 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.884867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06118c-bc4b-4d40-b393-5579a0e3fb67 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.889541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.890177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.890633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.890903 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.891585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.893467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.904111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1210/2430] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:30.907916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.919684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b118b05-95d4-4e8f-a079-51d3d557e732 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.924555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.925206 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.925614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.925883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.926534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.928298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f83ba-5794-4929-8644-a84d4120b29d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.943278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1221/2431] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:30.944814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:30.955248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63702f-810e-4ae5-aceb-f1ae3f353be2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:30.960266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:30.960933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:30.961215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:30.961492 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] PATH_INFO: `/v3/projects/53aaf7dba37844ec9302d4fa472e7268/users/9d17d1ef057a413c84de970e6f8188d9/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:30.977587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aaf7dba37844ec9302d4fa472e7268, user_id=9d17d1ef057a413c84de970e6f8188d9, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:30.980358 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:30.998257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1211/2432] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:30 2022] PUT /identity/v3/projects/53aaf7dba37844ec9302d4fa472e7268/users/9d17d1ef057a413c84de970e6f8188d9/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:31.008809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.009182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.009518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.039387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] MFA Rules not processed for user `9d17d1ef057a413c84de970e6f8188d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:31.040632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:31.117383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1222/2433] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:31.122701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.191121 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87971-6cef-426a-812e-fdc89caa3efb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.196269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.196899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.197182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.197457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.198095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.200084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.204924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:31.231739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1212/2434] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:31 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:31.236820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.248339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f85b3-47ef-4a56-a902-e201dc5ec2e8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.310130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.310742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.311009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.311273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.311907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.313836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.338555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1223/2435] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:31 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:31.343058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.353973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afa5d-649e-4508-8517-768f50c7871e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.359020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.359651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.359929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.360196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.360839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.362534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.373083 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1213/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:31.377453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.387348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4588e52-4a81-4245-a3da-9cf6819a2444 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.392675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.393389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.393658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.393921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] PATH_INFO: `/v3/projects/aa0ff116b7484db48fd14eb2f0563f49/users/1d1030f42aec49e3ab96b546b6c39730/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.411250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0ff116b7484db48fd14eb2f0563f49, user_id=1d1030f42aec49e3ab96b546b6c39730, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.414002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.428910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1224/2437] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:31 2022] PUT /identity/v3/projects/aa0ff116b7484db48fd14eb2f0563f49/users/1d1030f42aec49e3ab96b546b6c39730/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:31.434275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.444435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b4a5f-b0a0-42ec-9fbd-e614578103c0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.512223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.512835 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.513111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.513379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.514024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.515664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69e79-9088-4601-8641-930e549244b6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.527329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1214/2438] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:31.533035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.543718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d407d62-3b17-43c3-93be-4890c9bc6643 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.549554 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.550240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.550509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.550777 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] PATH_INFO: `/v3/projects/aa0ff116b7484db48fd14eb2f0563f49/users/1d1030f42aec49e3ab96b546b6c39730/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.552815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0ff116b7484db48fd14eb2f0563f49, user_id=1d1030f42aec49e3ab96b546b6c39730, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.555599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.562159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:31.568569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1225/2439] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:31 2022] PUT /identity/v3/projects/aa0ff116b7484db48fd14eb2f0563f49/users/1d1030f42aec49e3ab96b546b6c39730/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:31.583400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.583820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.584094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.613429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] MFA Rules not processed for user `1d1030f42aec49e3ab96b546b6c39730`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:31.614682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:31.693705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1215/2440] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:31.705592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.707477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:31.771403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315bbf-fae8-490f-b501-bbd9a81ba963 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.773081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.774813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:31.775545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.776244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.776524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.776826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.786840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.787734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212da82d-6a56-470e-8722-f9a444d11772 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.788493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.791648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.792310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.792590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.792861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.794731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:31.798637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1226/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:31.867651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:31.871551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.873561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58876-4f34-4b6d-a533-84c591181f1d service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.885908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1216/2442] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:31.890117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:31.900470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6618277-de72-4fb8-be2a-c065f943847f service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:31.904288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:31.904900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:31.905171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:31.905442 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:31.969656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:31.972001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:31.982630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1227/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:32.983815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:32.984315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:32.984407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:33.005484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:33.006738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:33.066352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1217/2444] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:33.078566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:33.080188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:33.154957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e011-5973-4bce-88b7-aae646a7bd66 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:33.160343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:33.161001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:33.161273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:33.161521 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:33.171576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:33.174174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:33.183414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1228/2445] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:28:42.770269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:42.771899 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:42.835164 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53c54-3742-4d74-8ce8-67ee3e733aec None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:42.839958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:42.840802 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:42.841354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:42.841901 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:42.844000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:42.922261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:42.923771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:42.934454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1218/2446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:43.179600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:46.795923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:46.797689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:46.820433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8b75-820b-4525-84e2-1ce75d10b0e9 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:46.827952 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:46.828656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:46.829471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:46.829981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] PATH_INFO: `/v3/users/b9d14f46c717426fa7ed83a2664043fe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:46.831127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d14f46c717426fa7ed83a2664043fe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:46.834415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:46.902439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d14f46c717426fa7ed83a2664043fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:46.916299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d14f46c717426fa7ed83a2664043fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:46.924874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d14f46c717426fa7ed83a2664043fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:46.925720 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d14f46c717426fa7ed83a2664043fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:46.926419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0c3fc09-0dfa-4008-8b37-2024fa4aaba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d14f46c717426fa7ed83a2664043fe'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:46.945810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1229/2447] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:46 2022] DELETE /identity/v3/users/b9d14f46c717426fa7ed83a2664043fe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:47.171100 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.185714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3977a-2597-470c-abc8-0b881b437e5f service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.243191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:47.260436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.261122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.261366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.261635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] PATH_INFO: `/v3/projects/202d6e504bb74d929dbe8c1d643c7693` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.263148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=202d6e504bb74d929dbe8c1d643c7693)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.265011 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.323614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202d6e504bb74d929dbe8c1d643c7693', 'request_id': 'req-8485e2b1-b19c-4108-a308-b9b742a5a74f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:47.333898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202d6e504bb74d929dbe8c1d643c7693', 'request_id': 'req-8485e2b1-b19c-4108-a308-b9b742a5a74f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:47.341386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202d6e504bb74d929dbe8c1d643c7693', 'request_id': 'req-8485e2b1-b19c-4108-a308-b9b742a5a74f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:47.354328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] The token cache is being invalidate because project 202d6e504bb74d929dbe8c1d643c7693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:47.354649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:47.355373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8485e2b1-b19c-4108-a308-b9b742a5a74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:47.357346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1219/2448] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:47 2022] DELETE /identity/v3/projects/202d6e504bb74d929dbe8c1d643c7693 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:47.362278 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.362558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.363289 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.385424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:47.386754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:47.457776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1230/2449] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:47.466912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.467574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.467954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.495398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:47.497113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:47.506572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1220/2450] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:47.511106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.521490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab0d7-43c9-4872-b97c-0906b247e32a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.526008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.526611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.526886 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.527152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.527859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:47.528157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.529765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.542266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1231/2451] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:47.546849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.558272 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a34d-42da-4804-b6a1-ba159ba93ec5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.564153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.564963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.565387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.565717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.566499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.568606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.608400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1221/2452] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:47 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:47.612868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.623714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d7c28-7781-41ad-8513-8dc78dfbc46f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.682317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.682999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.683349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.683573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.684228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.686164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.695750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:47.714909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1232/2453] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:47 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:47.716120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.727184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9665b-ee5b-407c-aac3-e30c89ebbb60 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.733065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.733688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.733988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.734282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.735231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.736851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.747858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1222/2454] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:28:47.752208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.763014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e86a-f41b-4087-a4c2-85d4f5c496ff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.767790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.768402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.768679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.768947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.769617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.771261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962b8b3-0784-4180-90f7-a8f803bf67cc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.782843 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1233/2455] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:47.787146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.798182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4647d-a341-47af-a0af-088d1f46f10b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:47.803784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:47.804442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.804715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.805086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] PATH_INFO: `/v3/projects/1f2e91eb72d34017910502cfd63d0fcb/users/13ce376a2b67454a89b544cd4173a9e2/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.822887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2e91eb72d34017910502cfd63d0fcb, user_id=13ce376a2b67454a89b544cd4173a9e2, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:47.829401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:47.844382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1223/2456] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:47 2022] PUT /identity/v3/projects/1f2e91eb72d34017910502cfd63d0fcb/users/13ce376a2b67454a89b544cd4173a9e2/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:47.859566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:47.860636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:47.861066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:47.898263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] MFA Rules not processed for user `13ce376a2b67454a89b544cd4173a9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:47.899514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:47.984265 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1234/2457] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:47.996515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:47.998304 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.127373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f7e0-706f-423c-bdc2-81c4763468cb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.138980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.139659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.139937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.140206 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.149558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.151425 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.159996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:48.166597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1224/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:48.185665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:48.189280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.320450 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c1b2-aad2-4cf5-95a5-245d74b32520 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.329855 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.330583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.330932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.331301 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] PATH_INFO: `/v3/users/9d17d1ef057a413c84de970e6f8188d9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.332582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d17d1ef057a413c84de970e6f8188d9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.340838 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.413889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d17d1ef057a413c84de970e6f8188d9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.431138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:48.442219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d17d1ef057a413c84de970e6f8188d9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.448054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:48.452857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc359-9280-4390-bdfd-c56ae1018e47 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.453592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d17d1ef057a413c84de970e6f8188d9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.455132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d17d1ef057a413c84de970e6f8188d9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.457399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f129a2a4-a9c8-4fa3-bb87-7bb58dbb73da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d17d1ef057a413c84de970e6f8188d9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.466606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.467821 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.468265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.468386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] PATH_INFO: `/v3/users/13ce376a2b67454a89b544cd4173a9e2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.469571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ce376a2b67454a89b544cd4173a9e2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.474559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.490788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1235/2459] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:48 2022] DELETE /identity/v3/users/9d17d1ef057a413c84de970e6f8188d9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:48.496993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eda01-ed33-487a-ab02-83660708e5ab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.497282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eda01-ed33-487a-ab02-83660708e5ab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.497559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eda01-ed33-487a-ab02-83660708e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.518317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-786eda01-ed33-487a-ab02-83660708e5ab None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:48.518563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-786eda01-ed33-487a-ab02-83660708e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.547846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ce376a2b67454a89b544cd4173a9e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.556829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ce376a2b67454a89b544cd4173a9e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.564561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ce376a2b67454a89b544cd4173a9e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.565328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ce376a2b67454a89b544cd4173a9e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.577836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ce376a2b67454a89b544cd4173a9e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:48.584097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1225/2460] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:48 2022] DELETE /identity/v3/users/13ce376a2b67454a89b544cd4173a9e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:48.587110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1236/2461] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:48.588573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:48.588823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.589144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.589681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.589988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.609334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:48.610524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.659442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d812ee2-fbb4-4172-9ffb-06c3f868151f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.664484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.665090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.665368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.665636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.667378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.670212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1237/2462] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:48.671066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:48.672551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.681462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.683110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.694467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1226/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:48.695339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:48.696714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:48.736331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4691-fcc3-48b8-9773-81b5773d26eb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.740543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.741164 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.741876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.742153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.754932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.756589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.771369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a30c-6895-40ad-b87b-566d9f274b52 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:48.774503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1238/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:48.776081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:48.776699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:48.776976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:48.777251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:48.792606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:48.794089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:48.805324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1227/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:49.220564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.222842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.238202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6373b6-50ac-4a70-8da3-9318151aafb1 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.244744 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.245538 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.246007 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.246464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] PATH_INFO: `/v3/projects/53aaf7dba37844ec9302d4fa472e7268` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.248029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53aaf7dba37844ec9302d4fa472e7268)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.250233 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.255332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.256767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.271931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:49.278493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006622-2700-4e47-a986-2d169218182f service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.289045 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.289919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.290239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.290512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] PATH_INFO: `/v3/projects/1f2e91eb72d34017910502cfd63d0fcb` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.292194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2e91eb72d34017910502cfd63d0fcb)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.294081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.298703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:49.323122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aaf7dba37844ec9302d4fa472e7268', 'request_id': 'req-24b35f94-a684-44f2-8340-2f6b443473c9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.329941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aaf7dba37844ec9302d4fa472e7268', 'request_id': 'req-24b35f94-a684-44f2-8340-2f6b443473c9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.337269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aaf7dba37844ec9302d4fa472e7268', 'request_id': 'req-24b35f94-a684-44f2-8340-2f6b443473c9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.352876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] The token cache is being invalidate because project 53aaf7dba37844ec9302d4fa472e7268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:49.353173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.353801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.358422 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1239/2466] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:49 2022] DELETE /identity/v3/projects/53aaf7dba37844ec9302d4fa472e7268 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:49.359354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.359510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2e91eb72d34017910502cfd63d0fcb', 'request_id': 'req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.360670 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.368451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2e91eb72d34017910502cfd63d0fcb', 'request_id': 'req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.374332 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2e91eb72d34017910502cfd63d0fcb', 'request_id': 'req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.386561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] The token cache is being invalidate because project 1f2e91eb72d34017910502cfd63d0fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:49.386852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.387513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8cd3282-567d-4d0a-bcae-baf3c6274c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.389039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1228/2467] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:49 2022] DELETE /identity/v3/projects/1f2e91eb72d34017910502cfd63d0fcb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:49.393778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123cd7-84b2-47f0-b339-de97cf788955 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.394064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123cd7-84b2-47f0-b339-de97cf788955 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.394340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123cd7-84b2-47f0-b339-de97cf788955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.413437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2123cd7-84b2-47f0-b339-de97cf788955 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:49.414648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2123cd7-84b2-47f0-b339-de97cf788955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.428057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35f94-a684-44f2-8340-2f6b443473c9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.483941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1229/2468] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:49.493007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.493211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.493343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.493472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.493955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.494234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.494634 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] PATH_INFO: `/v3/users/1d1030f42aec49e3ab96b546b6c39730` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.495781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1030f42aec49e3ab96b546b6c39730)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.497731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.516916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:49.518586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.532547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1230/2469] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:49.534483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.546331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a44c4-71c1-4ccf-b923-69977b8d1511 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.552095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.553309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.553593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.553869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.554656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:49.554839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.556515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.557652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1030f42aec49e3ab96b546b6c39730'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.570440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1231/2470] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:28:49.574874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.576312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:49.578103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1030f42aec49e3ab96b546b6c39730'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.586264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a990c-53cf-4036-8006-ed1f022f5f3a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.588115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1030f42aec49e3ab96b546b6c39730'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.589522 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1030f42aec49e3ab96b546b6c39730'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.590165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1030f42aec49e3ab96b546b6c39730'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:49.591893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.593462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.593927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.594205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.594849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.597457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.610642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1240/2471] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:49 2022] DELETE /identity/v3/users/1d1030f42aec49e3ab96b546b6c39730 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:49.610642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.623987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.643420 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1232/2472] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:49.646008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.648989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.707929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7674d-1e9f-4065-a23e-63bef339e62d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.710985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:49.733025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835eb1-694f-4182-93c1-e560e33b83ec admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.737876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.738491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.738753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.739014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.739679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.742373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.770355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.771068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1233/2473] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:49 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:49.771310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.771424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.771760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.774010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.775536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.785314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.786407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e01de-1b35-4a80-badb-926dd3751f36 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.787509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.791831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.792677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.796310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.796614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.797134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1241/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:49.797833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.800051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.811738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1234/2475] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:49.816310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.828161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb859d4-7633-460d-9512-611217f6c504 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.835599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.836320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.836667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.837000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.837721 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.839891 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402bd81-8298-4142-b182-b75948c01c73 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.851439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1242/2476] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:49.855727 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.867317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c51f-adfc-4742-81f9-9a019302be77 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:49.873493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:49.874433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.874717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.874987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] PATH_INFO: `/v3/projects/3487d26dae9a4192b532a1185f0a7c1b/users/02e728c270fd4959a5743c9c94301265/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.893456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3487d26dae9a4192b532a1185f0a7c1b, user_id=02e728c270fd4959a5743c9c94301265, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:49.896692 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:49.913374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1235/2477] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:49 2022] PUT /identity/v3/projects/3487d26dae9a4192b532a1185f0a7c1b/users/02e728c270fd4959a5743c9c94301265/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:49.924801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:49.925081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:49.925556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:49.947295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:49.949142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:49.964394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] MFA Rules not processed for user `02e728c270fd4959a5743c9c94301265`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:49.967250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.041879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337450d-740c-4ad2-b552-083fc4b21b00 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.048781 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.049516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.050029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.050311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] PATH_INFO: `/v3/projects/aa0ff116b7484db48fd14eb2f0563f49` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.051437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1243/2478] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:50.051577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0ff116b7484db48fd14eb2f0563f49)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.053548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.055858 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.067443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e858ff-0926-4f23-8c6f-a3024fd860cf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.072425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.073120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.073457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.073787 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.074491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.076605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.095983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:50.106664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0ff116b7484db48fd14eb2f0563f49', 'request_id': 'req-484c298b-2427-4b5b-a84b-ef63369f9671'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:50.114996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1244/2479] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:50.118642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0ff116b7484db48fd14eb2f0563f49', 'request_id': 'req-484c298b-2427-4b5b-a84b-ef63369f9671'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:50.119160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.124894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0ff116b7484db48fd14eb2f0563f49', 'request_id': 'req-484c298b-2427-4b5b-a84b-ef63369f9671'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:50.138120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] The token cache is being invalidate because project aa0ff116b7484db48fd14eb2f0563f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:50.138120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:50.138882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-484c298b-2427-4b5b-a84b-ef63369f9671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:50.140774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1236/2480] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:49 2022] DELETE /identity/v3/projects/aa0ff116b7484db48fd14eb2f0563f49 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:50.145545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03156-8dff-431d-937a-2cb40f4d126c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.145888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03156-8dff-431d-937a-2cb40f4d126c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.146224 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03156-8dff-431d-937a-2cb40f4d126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.166870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-04a03156-8dff-431d-937a-2cb40f4d126c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:50.168208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-04a03156-8dff-431d-937a-2cb40f4d126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.188259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba1305-5f09-4614-bdc1-89028a20b909 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.193272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.193882 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.194159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.194429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.195062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.197727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.207820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:50.226147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1245/2481] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:50.227261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.229650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.246231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c53520-0c29-4d3f-a0dc-14fa5ff78edd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.252769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.253496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.253669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.253944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.254707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.254877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1237/2482] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:50.256461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.264921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.265387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.265846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.267176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1246/2483] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:28:50.271329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.282159 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc827c3-0ede-46ed-9d6d-6fc9f45b4bf3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.287226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.288020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.288395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.288756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] PATH_INFO: `/v3/projects/ba61787844ee492b8054c3be0c9d7fb8/users/63656668cb2948a493d9dbe52d6a1949/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.291094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:50.292408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.301797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1238/2484] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:50.305815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.308262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba61787844ee492b8054c3be0c9d7fb8, user_id=63656668cb2948a493d9dbe52d6a1949, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.311147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.316202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947867c6-8d22-4dc9-97aa-bb0f5ce15927 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.322221 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.322874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.323127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.323480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.324179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:50.324484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.326081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.330350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1247/2485] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:50 2022] PUT /identity/v3/projects/ba61787844ee492b8054c3be0c9d7fb8/users/63656668cb2948a493d9dbe52d6a1949/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:50.334446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.342731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1239/2486] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:50.346180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.356432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e313-fa12-4ca3-89d2-7bdf705fef4c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.404556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d700-7790-46dd-b7c4-b234005d5352 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.410894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.411537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.411815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.412104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.412727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.414643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.418838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.419578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.419927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.420205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.420909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.422928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.428367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1248/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:28:50.429300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.440063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61031e-f98b-481b-81a0-15ef43af6594 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.445191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.445850 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.446127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.446401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] PATH_INFO: `/v3/projects/ba61787844ee492b8054c3be0c9d7fb8/users/63656668cb2948a493d9dbe52d6a1949/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.448379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba61787844ee492b8054c3be0c9d7fb8, user_id=63656668cb2948a493d9dbe52d6a1949, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.451019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0130f-fdd4-4702-8544-045851ad5173 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.460020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1240/2488] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:50.464194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.470669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1249/2489] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:50 2022] PUT /identity/v3/projects/ba61787844ee492b8054c3be0c9d7fb8/users/63656668cb2948a493d9dbe52d6a1949/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:50.482194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.482472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.482745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.515729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] MFA Rules not processed for user `63656668cb2948a493d9dbe52d6a1949`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:50.516941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.536130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad7543-8ba5-4cf9-949f-54be540775dd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.538363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:50.541679 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.542303 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.542644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.542981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.543649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.545889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.571190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1241/2490] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:50.575837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.586862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cb86-6842-45f4-aa26-ecfe5d77dd8c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.592132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.592815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.593152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.593396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.594138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.595908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.598775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1250/2491] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:50.606846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1242/2492] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:28:50.611023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.611947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.613825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.623706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7f85-0550-4247-a518-bd1616b419a2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.629445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.630065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.630340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.630608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.631286 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.632897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.636695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:50.645556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1251/2493] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:50.649677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.660650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe94d6-75c9-4539-b114-4a3cc20737e2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.665537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.665899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.666172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.666440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] PATH_INFO: `/v3/projects/95841433b4044ea594328fe3cc724631/users/79b254f01c794416912d176008ba7c24/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.680673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7145f-8c0e-40ef-9f4d-9d09de08de52 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.682801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95841433b4044ea594328fe3cc724631, user_id=79b254f01c794416912d176008ba7c24, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.684372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.684989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.685269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.685544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.685641 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88b744-2260-420e-a5c7-8ac73f1a3c94 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.695998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.697435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04464d16-09c1-461f-978e-658be43f1c20 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.699325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1252/2494] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:50 2022] PUT /identity/v3/projects/95841433b4044ea594328fe3cc724631/users/79b254f01c794416912d176008ba7c24/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:50.709447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.709447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.709447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.709756 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1243/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:50.710632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.710912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.711180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.735362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:50.737198 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.744469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] MFA Rules not processed for user `79b254f01c794416912d176008ba7c24`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:50.745717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.845042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1253/2496] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:50.854372 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.854879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1244/2497] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:50.856247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:50.858916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.935753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800824a-e470-453f-bf81-dd615e9edaa4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.946151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.947170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.947525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.948020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.948694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.951517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.969396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300655-5f30-4307-ab58-0f90839e7f9b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:50.975145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:50.975871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:50.976207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:50.976726 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:50.986046 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:50.987822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:50.989651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1245/2498] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:50.993675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:50.997383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1254/2499] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 05:28:51.034674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:51.091245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c2bd-d23f-4586-bf2c-2640da716b54 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.098776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.099453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.099769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.100069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.100784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.103340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.140199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1246/2500] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:50 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:51.145471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.171678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5914b-b0ec-4540-9702-b5f7c4615e5f service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.178035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.178728 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.178959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.179291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.180022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.181602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.195257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1255/2501] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:51.201853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.227857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0c5fd-a005-4380-bc84-9a16691966b4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.234070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.236255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.236255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.236255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] PATH_INFO: `/v3/projects/b248047f61b54308b22352186e3fa48f/users/a6c5a472d1ee4ea08067945eb53f511c/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.247275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.261874 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017fe5-899e-4eb6-9949-f228330cf6c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.272310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.274752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.274968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.275316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] PATH_INFO: `/v3/users/02e728c270fd4959a5743c9c94301265` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.278365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e728c270fd4959a5743c9c94301265)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.279478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b248047f61b54308b22352186e3fa48f, user_id=a6c5a472d1ee4ea08067945eb53f511c, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.282305 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.285652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.288173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:51.311162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1247/2502] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:51 2022] PUT /identity/v3/projects/b248047f61b54308b22352186e3fa48f/users/a6c5a472d1ee4ea08067945eb53f511c/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:51.316147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.392454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e728c270fd4959a5743c9c94301265'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:51.416475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e728c270fd4959a5743c9c94301265'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:51.422809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed6b33-bfb4-46fc-b5ea-c7ecd681a7ce admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.431512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.432559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e728c270fd4959a5743c9c94301265'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:51.432852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.433475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.434025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.434146 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e728c270fd4959a5743c9c94301265'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:51.435177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.435649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0976c6-d783-4877-aac7-df0665c8d81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e728c270fd4959a5743c9c94301265'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:51.437374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.455306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1248/2503] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:28:51.460357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.462795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:51.483258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1256/2504] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:51 2022] DELETE /identity/v3/users/02e728c270fd4959a5743c9c94301265 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:51.486051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.486623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.487138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.487503 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24550-cf5d-4bec-88f3-84749d9e1073 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.510438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:51.511697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:51.565529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.567066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.567724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.568220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] PATH_INFO: `/v3/projects/b248047f61b54308b22352186e3fa48f/users/a6c5a472d1ee4ea08067945eb53f511c/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.570512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b248047f61b54308b22352186e3fa48f, user_id=a6c5a472d1ee4ea08067945eb53f511c, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.573481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ef9e3-b096-41c6-8ceb-271ec0275b83 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.585646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1249/2505] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:51 2022] PUT /identity/v3/projects/b248047f61b54308b22352186e3fa48f/users/a6c5a472d1ee4ea08067945eb53f511c/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:51.596428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.596767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.597047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.639158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] MFA Rules not processed for user `a6c5a472d1ee4ea08067945eb53f511c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:51.639158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:51.644444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1257/2506] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:51.654458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.656314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:51.673269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:51.745746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1250/2507] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:51.761463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:51.763486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:51.769696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07692cd8-92c2-4331-9c5c-c099183c5900 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.829369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:51.846576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9f16-0796-4829-8336-ea517fb0cda6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:51.852326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.853565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.853999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.854429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.866954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.868449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:51.874544 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:51.875529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:51.876017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:51.876926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:51.887417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1251/2508] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:51.991669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:51.993691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.018175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1258/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:52.424722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.436580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.439956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:52.441058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d1f4-9d0c-45aa-b6c5-0b758d451d24 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.446579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6c5a472d1ee4ea08067945eb53f511c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b248047f61b54308b22352186e3fa48f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.447530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.447883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.448307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.449102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:52.449486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.451662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.464364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3fa68-ad61-4a95-9df5-0425b2406d16 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.479050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.479747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.480029 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.480270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] PATH_INFO: `/v3/projects/3487d26dae9a4192b532a1185f0a7c1b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.481783 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3487d26dae9a4192b532a1185f0a7c1b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.483792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.499830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1252/2510] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:52.505677 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.520480 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb28bd-95ff-4f4b-b1b5-7d2b8dc0b9ff tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.527328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6c5a472d1ee4ea08067945eb53f511c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b248047f61b54308b22352186e3fa48f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.528414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.528929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.529210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.529859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.531845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.569440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3487d26dae9a4192b532a1185f0a7c1b', 'request_id': 'req-3b9d5d84-d89e-4e96-843a-e000534e4ff6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.573906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1253/2511] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:52 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:52.574997 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.577542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3487d26dae9a4192b532a1185f0a7c1b', 'request_id': 'req-3b9d5d84-d89e-4e96-843a-e000534e4ff6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.587683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3487d26dae9a4192b532a1185f0a7c1b', 'request_id': 'req-3b9d5d84-d89e-4e96-843a-e000534e4ff6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.605993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] The token cache is being invalidate because project 3487d26dae9a4192b532a1185f0a7c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:52.606436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.607534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.612097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1259/2512] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:52 2022] DELETE /identity/v3/projects/3487d26dae9a4192b532a1185f0a7c1b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:52.620526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.623167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:52.662818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2950e-c228-499e-9437-ed0e0129cf1d tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.670668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6c5a472d1ee4ea08067945eb53f511c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b248047f61b54308b22352186e3fa48f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.670668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.670668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.671342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.671342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:52.671342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.673130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.687253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1254/2513] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:52.712136 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d5d84-d89e-4e96-843a-e000534e4ff6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.726647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:52.746804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:52.749285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:52.762815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c24d6-a6a3-4a6b-8ca0-45cc348272e4 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:52.768024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6c5a472d1ee4ea08067945eb53f511c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b248047f61b54308b22352186e3fa48f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.768667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.769041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.769318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] PATH_INFO: `/v3/projects/908efb4096cc49cd8bafa690b6e55f1b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.770571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=908efb4096cc49cd8bafa690b6e55f1b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.772609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.788900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:52.793042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:52.794347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:52.795595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:52.795877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] PATH_INFO: `/v3/users/63656668cb2948a493d9dbe52d6a1949` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:52.797221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63656668cb2948a493d9dbe52d6a1949)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:52.799288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:52.852693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908efb4096cc49cd8bafa690b6e55f1b', 'request_id': 'req-a1cba9df-84b3-4728-8c6f-65d0af6cf294'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.863900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908efb4096cc49cd8bafa690b6e55f1b', 'request_id': 'req-a1cba9df-84b3-4728-8c6f-65d0af6cf294'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.873106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908efb4096cc49cd8bafa690b6e55f1b', 'request_id': 'req-a1cba9df-84b3-4728-8c6f-65d0af6cf294'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.884045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63656668cb2948a493d9dbe52d6a1949'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.897195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] The token cache is being invalidate because project 908efb4096cc49cd8bafa690b6e55f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:52.898033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.898938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.901215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63656668cb2948a493d9dbe52d6a1949'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.902036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1255/2514] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:52 2022] DELETE /identity/v3/projects/908efb4096cc49cd8bafa690b6e55f1b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:52.910382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63656668cb2948a493d9dbe52d6a1949'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.911407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63656668cb2948a493d9dbe52d6a1949'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.912257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63656668cb2948a493d9dbe52d6a1949'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:52.935614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1260/2515] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:52 2022] DELETE /identity/v3/users/63656668cb2948a493d9dbe52d6a1949 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:53.154049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.156105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.270150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba9df-84b3-4728-8c6f-65d0af6cf294 tempest-VolumeQuotaClassesTest-1469191257 tempest-VolumeQuotaClassesTest-1469191257-project-admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:53.328124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.338199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.358334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:53.359357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.359699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.361259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] PATH_INFO: `/v3/users/79b254f01c794416912d176008ba7c24` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.362848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b254f01c794416912d176008ba7c24)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:53.365186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:53.472823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b254f01c794416912d176008ba7c24'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.476853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:53.491166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b254f01c794416912d176008ba7c24'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.501387 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b254f01c794416912d176008ba7c24'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.502890 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b254f01c794416912d176008ba7c24'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.518913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c68f9023-32f9-4003-bb55-d8484c307588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b254f01c794416912d176008ba7c24'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.520201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122104e-2c93-40a4-8d4f-8f11e22b0a26 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:53.525481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1256/2516] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:53 2022] DELETE /identity/v3/users/79b254f01c794416912d176008ba7c24 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:53.530046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.530319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.530590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.535924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:53.537318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.537914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.538400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] PATH_INFO: `/v3/projects/ba61787844ee492b8054c3be0c9d7fb8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.539959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba61787844ee492b8054c3be0c9d7fb8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:53.542039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:53.553665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:53.555033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.640582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:53.656401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1257/2517] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:53.657669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.660559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.668173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba61787844ee492b8054c3be0c9d7fb8', 'request_id': 'req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.676469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba61787844ee492b8054c3be0c9d7fb8', 'request_id': 'req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.688302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba61787844ee492b8054c3be0c9d7fb8', 'request_id': 'req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.713050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] The token cache is being invalidate because project ba61787844ee492b8054c3be0c9d7fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:53.713546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.714109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-adf1648f-9a2a-4c2c-8eaf-d29b76012ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:53.723630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1261/2518] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:53 2022] DELETE /identity/v3/projects/ba61787844ee492b8054c3be0c9d7fb8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:53.725517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff05c60-fe03-4f05-adf0-2ece9a45eff0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.725800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff05c60-fe03-4f05-adf0-2ece9a45eff0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.726064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff05c60-fe03-4f05-adf0-2ece9a45eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.740081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c69cb-d66c-4748-9588-7c02695e65a5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:53.750871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8ff05c60-fe03-4f05-adf0-2ece9a45eff0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:53.752514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ff05c60-fe03-4f05-adf0-2ece9a45eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.809050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:53.809668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.809952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.810482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.812273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.827873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1262/2519] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:53.836031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.836314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.836695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.859151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:53.860421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:53.860625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:53.870839 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1263/2520] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:53.874908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.886407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e24f0-b3cd-49b0-ac01-37688d1e6b92 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:53.894626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:53.895553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.896002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.896411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.897219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:53.897635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:53.899410 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:53.914463 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1264/2521] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:53.918756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.924201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:53.927949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:53.939474 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1258/2522] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:53.946218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f6454-beb6-4a9e-a32c-903a4e6dad06 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:53.951162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:53.951969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:53.952246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:53.952658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:53.953295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:53.955421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:53.990309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:53.999292 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1265/2523] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:53 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:54.002138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d1af-6fc7-4dc7-bdab-d8216ac42408 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.098522 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.099266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.099766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.099860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.100460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.102487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.149653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1259/2524] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:53 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:54.153867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.168652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49213d35-e82c-4e32-8591-56ddb7c6bb63 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.180139 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.180908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.181195 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.181516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.190290 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.192071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.210245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1266/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:54.214211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.226804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4410ae-a22b-463a-bec8-289c97e42ae6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.236278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.237005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.237383 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.237815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.238646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.240640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.254018 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1260/2526] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:54.258349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.269791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6f3a-f8e4-437a-967e-1788d6752b67 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.277517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.278348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.278678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.278948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] PATH_INFO: `/v3/projects/b801bc6837414e6cbcaf1eb55cdef683/users/a5abd08739e54dd8b926d0a3ce03f5e2/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.306145 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b801bc6837414e6cbcaf1eb55cdef683, user_id=a5abd08739e54dd8b926d0a3ce03f5e2, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.309734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44835c-7905-4f03-b118-15cee0baa390 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.326598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.328897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:54.333379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1267/2527] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:54 2022] PUT /identity/v3/projects/b801bc6837414e6cbcaf1eb55cdef683/users/a5abd08739e54dd8b926d0a3ce03f5e2/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:54.345467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.345758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.346031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.351349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4be4-3235-4ded-a990-40fe7052b7e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.387419 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] MFA Rules not processed for user `a5abd08739e54dd8b926d0a3ce03f5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:54.389103 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:54.439613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.440186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.440488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.440768 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] PATH_INFO: `/v3/projects/95841433b4044ea594328fe3cc724631` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.441951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95841433b4044ea594328fe3cc724631)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.443972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.475709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:54.508908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1268/2528] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:54.513766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.526425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc475b-cd9a-4360-84ec-7597d4912c2c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.556959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95841433b4044ea594328fe3cc724631', 'request_id': 'req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.560552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:54.570309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95841433b4044ea594328fe3cc724631', 'request_id': 'req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.583921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95841433b4044ea594328fe3cc724631', 'request_id': 'req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.602972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] The token cache is being invalidate because project 95841433b4044ea594328fe3cc724631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:54.603323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.604342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.607112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1261/2529] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:54 2022] DELETE /identity/v3/projects/95841433b4044ea594328fe3cc724631 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:54.611794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.613843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:54.653019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.653793 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.654170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.654530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.655277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.657297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.700815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9940-164a-4a01-ad97-bb8f5a5cad5f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.707599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.708264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.708546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.708838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] PATH_INFO: `/v3/users/a6c5a472d1ee4ea08067945eb53f511c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.709987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c5a472d1ee4ea08067945eb53f511c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.712470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.713953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1269/2530] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:54 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:54.717814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.721624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:54.802380 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c5a472d1ee4ea08067945eb53f511c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.813055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c5a472d1ee4ea08067945eb53f511c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.822571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c5a472d1ee4ea08067945eb53f511c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.823101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efb6b-cdfb-4030-91fb-8a86358d0f89 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.823323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c5a472d1ee4ea08067945eb53f511c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.828953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.830389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.830731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.831081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.831814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.834660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.838279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c5a472d1ee4ea08067945eb53f511c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:54.850472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1262/2531] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:54 2022] DELETE /identity/v3/users/a6c5a472d1ee4ea08067945eb53f511c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:54.866100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1270/2532] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:54 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:54.870600 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:54.872135 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:54.983777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea517-52ab-4348-a911-d584ba94fe38 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:54.989299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:54.990017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:54.990315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:54.990591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:54.991867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:54.993264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:54.995089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:55.009530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1263/2533] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:55.010210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.023377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bcd9b-7571-49a7-bc42-0558f713018b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.029020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.029691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.029966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.030235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] PATH_INFO: `/v3/projects/651619b9498544f2b9cc85b905478973/users/ec449951290f4b7cbd3c68ba887b9f48/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.051536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651619b9498544f2b9cc85b905478973, user_id=ec449951290f4b7cbd3c68ba887b9f48, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.054571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.077347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1271/2534] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:55 2022] PUT /identity/v3/projects/651619b9498544f2b9cc85b905478973/users/ec449951290f4b7cbd3c68ba887b9f48/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:55.081576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.093801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d02e3-5696-499a-aa28-68c9bf37e26e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.167894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.168852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.169355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.169842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.170747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.172612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.188714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1264/2535] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:55.193232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.218119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.222968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.225556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f791b-5d4d-41af-af10-27d63cc90772 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.232892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.233580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.233847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.234124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] PATH_INFO: `/v3/projects/651619b9498544f2b9cc85b905478973/users/ec449951290f4b7cbd3c68ba887b9f48/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.236224 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651619b9498544f2b9cc85b905478973, user_id=ec449951290f4b7cbd3c68ba887b9f48, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.239068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7ec98-13c3-4ce1-87a9-1fa98ea3ca16 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.239516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b02a4-5946-4e00-b2f6-85625a340b32 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.247858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.248649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.248998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.249298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] PATH_INFO: `/v3/projects/b248047f61b54308b22352186e3fa48f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.250538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b248047f61b54308b22352186e3fa48f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.253269 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.259454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1272/2536] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:55 2022] PUT /identity/v3/projects/651619b9498544f2b9cc85b905478973/users/ec449951290f4b7cbd3c68ba887b9f48/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:55.277922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.278527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.278813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.336408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] MFA Rules not processed for user `ec449951290f4b7cbd3c68ba887b9f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:55.337647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.342208 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:55.356995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b248047f61b54308b22352186e3fa48f', 'request_id': 'req-9ff36243-f8b3-4977-8ed2-829839af0932'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:55.368557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b248047f61b54308b22352186e3fa48f', 'request_id': 'req-9ff36243-f8b3-4977-8ed2-829839af0932'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:55.378104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b248047f61b54308b22352186e3fa48f', 'request_id': 'req-9ff36243-f8b3-4977-8ed2-829839af0932'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:55.393612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] The token cache is being invalidate because project b248047f61b54308b22352186e3fa48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:55.393904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:55.394585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ff36243-f8b3-4977-8ed2-829839af0932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:55.399234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1265/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:55 2022] DELETE /identity/v3/projects/b248047f61b54308b22352186e3fa48f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:55.404190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5523-3a01-4184-b65c-35672fe91713 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.404190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5523-3a01-4184-b65c-35672fe91713 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.404190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5523-3a01-4184-b65c-35672fe91713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.430170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2e9a5523-3a01-4184-b65c-35672fe91713 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:55.431440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2e9a5523-3a01-4184-b65c-35672fe91713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.464927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1273/2538] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:55.476295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.480071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.518582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1266/2539] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:55.520648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.520932 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.521207 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.541876 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:55.543175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.555704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1dc4b-25bd-4032-b968-57a2eac8dd26 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.559969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1267/2540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:28:55.560221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.560976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.561189 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.561604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.562049 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.572020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d561d-005e-4099-b44b-33d50ac3377e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.573361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.575126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.577029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.577650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.577929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.578199 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.578851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:28:55.579442 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.581715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.584872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:55.586803 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1274/2541] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:55.600636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1268/2542] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:28:55.601296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.618912 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8040-e839-4c69-9126-ad8ee7bbe07e service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.638558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.639556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.639835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.640106 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.640820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.643060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.687799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1275/2543] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:55.691950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.697736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.707000 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b3fa-3391-45f0-b88c-b1f2546ee7aa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.762364 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4b08-741e-4dc1-aa02-533162599b8c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.766362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.767190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.767525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.767859 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.770230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:55.772179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.773143 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.773656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.774195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.775398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.778114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.826490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1269/2544] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:55 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:55.828322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.855311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4991bc-ad37-4180-bf17-5760ced071be admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.856331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:55.863817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.864454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.864735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.865005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.865661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.867602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.885908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1270/2545] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:55.887230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.902536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a13b7-a820-4d9a-8d5b-4e7b83f6fe6c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.917539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.918174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.918443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.918717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:55.919391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.922123 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7083a-70bd-4db7-8a23-d577fe54c746 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.922409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:55.924255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:55.935003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1276/2546] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:55.940367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1271/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:55.949724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:55.974131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5b21-78b6-401b-8c04-ff81a9394cee service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:55.979434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:55.980498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:55.980904 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:55.991762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] PATH_INFO: `/v3/projects/b12df7e22b3342548c089501aeb1f1e0/users/d0bac81d711f4bdb8b3976cd8c7221a6/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.025709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12df7e22b3342548c089501aeb1f1e0, user_id=d0bac81d711f4bdb8b3976cd8c7221a6, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.031512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.062482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1277/2548] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:55 2022] PUT /identity/v3/projects/b12df7e22b3342548c089501aeb1f1e0/users/d0bac81d711f4bdb8b3976cd8c7221a6/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:56.073341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.073630 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.073907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.140729 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] MFA Rules not processed for user `d0bac81d711f4bdb8b3976cd8c7221a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:56.142571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:56.226014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1272/2549] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:56.230603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.297663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeaaba-c99d-49df-af35-c9006c62441e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.302836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.303615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.304001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.304386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.305113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.307236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.339929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1278/2550] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:28:56 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:28:56.341098 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.353119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae655f-88f0-4223-a35e-37eb9aed709c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.411030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:56.421508 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.422136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.422417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.422688 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.423449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.425407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.446844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1273/2551] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:28:56 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:28:56.450842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.462580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da9e37-157c-4bd0-87b7-6cd977d529b5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.469534 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.471333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.471615 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.471883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.472542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.474179 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.485973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1279/2552] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:56.490251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.502339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2824-ddc2-4efe-aa85-6aaa855bfb80 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.507879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.508599 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.508877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.509150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] PATH_INFO: `/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53/users/c6651fec1209483f8200093a34cc7cc5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.525376 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=88668ec4a49c4f56a1ea24e881ab8e53, user_id=c6651fec1209483f8200093a34cc7cc5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.528920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.552478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1274/2553] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:56 2022] PUT /identity/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53/users/c6651fec1209483f8200093a34cc7cc5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:56.556531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.567320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f69e-3fec-4f65-b1ff-187e78e8afef admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.633048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.633694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.633970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.634383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.635028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.636725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5103814-bcd3-4f2f-94d1-d10255a332c5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.650949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1280/2554] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:28:56.652185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.664316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516a3a-7cf7-4de5-8174-49654d58c7fa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.669320 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.670005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.670285 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.670556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] PATH_INFO: `/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53/users/c6651fec1209483f8200093a34cc7cc5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.672703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88668ec4a49c4f56a1ea24e881ab8e53, user_id=c6651fec1209483f8200093a34cc7cc5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.675894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.687235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1275/2555] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:28:56 2022] PUT /identity/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53/users/c6651fec1209483f8200093a34cc7cc5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:28:56.701646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.701973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.702231 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.732676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] MFA Rules not processed for user `c6651fec1209483f8200093a34cc7cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:56.733960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:56.744969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:56.808586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1281/2556] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:56.819765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:56.882520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645381e-eec9-47e0-b072-8ee18e1e8d64 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:56.886174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:56.886790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:56.887067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:56.887365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:56.897966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:56.899872 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:56.911240 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1276/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:57.017823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:57.028098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546abf7-85de-4754-be27-3d5f3feff43e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:57.031731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:57.032462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:57.032958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:57.033248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:57.103316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:57.104794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50daf7-68a7-467f-8bca-8ef41ca82131 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:57.127565 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1282/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:28:58.993819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:58.995437 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:59.066506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c33ede-7e77-41c1-9796-58b0b53a607e service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:59.071937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:59.072605 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:59.072887 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:59.073162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] PATH_INFO: `/v3/users/a5abd08739e54dd8b926d0a3ce03f5e2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:59.074281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5abd08739e54dd8b926d0a3ce03f5e2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:59.076280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:59.132743 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5abd08739e54dd8b926d0a3ce03f5e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.135466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:59.141445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5abd08739e54dd8b926d0a3ce03f5e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.149468 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5abd08739e54dd8b926d0a3ce03f5e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.150148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5abd08739e54dd8b926d0a3ce03f5e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.162243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5abd08739e54dd8b926d0a3ce03f5e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.168281 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1277/2559] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:58 2022] DELETE /identity/v3/users/a5abd08739e54dd8b926d0a3ce03f5e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:59.172769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:59.173273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:59.173366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:59.193259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:28:59.194492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:59.256590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1283/2560] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:28:59.266570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:59.268308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:59.342789 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001052f6-939f-417d-a1f1-064367d6804d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:59.347447 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:59.348059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:59.348337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:59.348608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:59.358717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:59.360330 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:59.371722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1278/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:28:59.665444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:59.667015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:59.680057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acbd4b-46a2-4255-bd7a-028d89a57555 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:59.685322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:59.685968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:59.686245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:59.686514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] PATH_INFO: `/v3/projects/b801bc6837414e6cbcaf1eb55cdef683` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:59.687772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b801bc6837414e6cbcaf1eb55cdef683)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:59.690512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:59.739177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:59.746937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b801bc6837414e6cbcaf1eb55cdef683', 'request_id': 'req-0e4eaff3-db7e-476c-bb77-96d2909c5403'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.753457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b801bc6837414e6cbcaf1eb55cdef683', 'request_id': 'req-0e4eaff3-db7e-476c-bb77-96d2909c5403'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.759149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b801bc6837414e6cbcaf1eb55cdef683', 'request_id': 'req-0e4eaff3-db7e-476c-bb77-96d2909c5403'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.772048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] The token cache is being invalidate because project b801bc6837414e6cbcaf1eb55cdef683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:28:59.772337 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.772976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.774458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1284/2562] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:28:59 2022] DELETE /identity/v3/projects/b801bc6837414e6cbcaf1eb55cdef683 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:59.778620 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:59.789081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89933b9-efb2-4d3a-8192-00db922bfe8d service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:28:59.855682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:28:59.856331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:28:59.856583 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:28:59.856854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] PATH_INFO: `/v3/users/ec449951290f4b7cbd3c68ba887b9f48` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:28:59.858010 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec449951290f4b7cbd3c68ba887b9f48)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:28:59.859973 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:28:59.908596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec449951290f4b7cbd3c68ba887b9f48'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.915698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec449951290f4b7cbd3c68ba887b9f48'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.922640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec449951290f4b7cbd3c68ba887b9f48'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.923362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec449951290f4b7cbd3c68ba887b9f48'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.930170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:28:59.936504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8cb1ec1b-7eee-40f8-a140-e036674e53b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec449951290f4b7cbd3c68ba887b9f48'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:28:59.944171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1279/2563] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:59 2022] DELETE /identity/v3/users/ec449951290f4b7cbd3c68ba887b9f48 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:28:59.978460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:28:59.980273 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:28:59.994698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eaff3-db7e-476c-bb77-96d2909c5403 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.058251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.058890 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.059185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.059483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] PATH_INFO: `/v3/users/d0bac81d711f4bdb8b3976cd8c7221a6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.060630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bac81d711f4bdb8b3976cd8c7221a6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.062592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.128582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bac81d711f4bdb8b3976cd8c7221a6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.142479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bac81d711f4bdb8b3976cd8c7221a6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.149689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bac81d711f4bdb8b3976cd8c7221a6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.150437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bac81d711f4bdb8b3976cd8c7221a6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.151031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bac81d711f4bdb8b3976cd8c7221a6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.166097 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1285/2564] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:28:59 2022] DELETE /identity/v3/users/d0bac81d711f4bdb8b3976cd8c7221a6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:00.170685 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.171188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.171333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.190507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:00.191769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.234908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.236548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.267001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1280/2565] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:00.278048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.279490 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.292122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:00.309530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86bfb-1820-4010-981c-54c530af4f7f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.314822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.315518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.315800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.316072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] PATH_INFO: `/v3/projects/651619b9498544f2b9cc85b905478973` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.317240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=651619b9498544f2b9cc85b905478973)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.319226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.376676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651619b9498544f2b9cc85b905478973', 'request_id': 'req-e9a005ae-a11e-40a5-b47f-61e19773d47d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.384800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651619b9498544f2b9cc85b905478973', 'request_id': 'req-e9a005ae-a11e-40a5-b47f-61e19773d47d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.392104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651619b9498544f2b9cc85b905478973', 'request_id': 'req-e9a005ae-a11e-40a5-b47f-61e19773d47d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.407934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] The token cache is being invalidate because project 651619b9498544f2b9cc85b905478973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:00.408393 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.409125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e9a005ae-a11e-40a5-b47f-61e19773d47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.411065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1286/2566] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:00 2022] DELETE /identity/v3/projects/651619b9498544f2b9cc85b905478973 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:00.415871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd21dc-8d18-4ef3-a127-0f01b27cfaa4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.416252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd21dc-8d18-4ef3-a127-0f01b27cfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.416597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd21dc-8d18-4ef3-a127-0f01b27cfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.437775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cdcd21dc-8d18-4ef3-a127-0f01b27cfaa4 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:00.439282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cdcd21dc-8d18-4ef3-a127-0f01b27cfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.473613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e749ba-c866-47c7-85a1-82da220d7475 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.507167 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1287/2567] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:00.515104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.515434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.515709 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.523950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.524602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.524910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.525177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.526970 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.535688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:00.536903 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.539805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.541237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.545222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1288/2568] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:00.550119 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.551553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1281/2569] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:29:00.559296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8512037-9e28-4202-a2e4-82cb27bd2625 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.564303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.565009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.565282 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.565545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.566234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:00.566525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.568165 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.580566 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1289/2570] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:29:00.585130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.595114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9673a96-f7fd-445e-99dd-52e51d49f4f6 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.599810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d525be-7702-497a-a095-16d262061632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.600393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d525be-7702-497a-a095-16d262061632 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.600664 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d525be-7702-497a-a095-16d262061632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.600937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d525be-7702-497a-a095-16d262061632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.601637 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d525be-7702-497a-a095-16d262061632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.603523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d525be-7702-497a-a095-16d262061632 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.633843 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1282/2571] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:00.637979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.648618 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1bb5-9074-4b49-95d1-ed88dd2b638b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.721561 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.722186 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.722460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.722727 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.723397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.725321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.733549 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:00.750740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1290/2572] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:00.754611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d525be-7702-497a-a095-16d262061632 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.766342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d525be-7702-497a-a095-16d262061632 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.771500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.772196 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.772564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.773051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.773778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.775573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.788777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1283/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:00.793368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.805471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ffb78-fb86-4906-800b-1f0157a2bf15 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.815276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.815893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.816171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.816441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.817091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.818718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.837355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1291/2574] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:00.842012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.855566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9b71-bbe6-436d-9393-bac8ebf5bcb3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.857900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.860123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.865277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.866585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.867027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.867483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] PATH_INFO: `/v3/projects/23e6c234a3fc45d290b4379dc9ac8edb/users/6f619e4c213f427997765cdfb441e9d6/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.880466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296b377-e552-4df5-ac11-5287a77cf09a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:00.883324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:00.886915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:00.887117 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e6c234a3fc45d290b4379dc9ac8edb, user_id=6f619e4c213f427997765cdfb441e9d6, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.887368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.887696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.887961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] PATH_INFO: `/v3/projects/b12df7e22b3342548c089501aeb1f1e0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.889117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12df7e22b3342548c089501aeb1f1e0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:00.890573 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c9519-e28c-4c7c-b07a-3383f70f302e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.891172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:00.916260 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1284/2575] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:00 2022] PUT /identity/v3/projects/23e6c234a3fc45d290b4379dc9ac8edb/users/6f619e4c213f427997765cdfb441e9d6/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:00.928565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:00.929107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:00.929466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:00.959742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12df7e22b3342548c089501aeb1f1e0', 'request_id': 'req-3ba49636-8bd6-4c71-aea1-75494dd670d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.963130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] MFA Rules not processed for user `6f619e4c213f427997765cdfb441e9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:00.964419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:00.966769 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12df7e22b3342548c089501aeb1f1e0', 'request_id': 'req-3ba49636-8bd6-4c71-aea1-75494dd670d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.973699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12df7e22b3342548c089501aeb1f1e0', 'request_id': 'req-3ba49636-8bd6-4c71-aea1-75494dd670d8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.988551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] The token cache is being invalidate because project b12df7e22b3342548c089501aeb1f1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:00.988941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.989663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:00.991758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1292/2576] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:00 2022] DELETE /identity/v3/projects/b12df7e22b3342548c089501aeb1f1e0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:00.995567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:00.997068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.035467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1285/2577] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:01.036369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.037724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.064061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49636-8bd6-4c71-aea1-75494dd670d8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.068939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.069568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.069841 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.070104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] PATH_INFO: `/v3/users/c6651fec1209483f8200093a34cc7cc5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.071325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6651fec1209483f8200093a34cc7cc5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.073354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.105725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b00e-2c81-40ea-b170-203ff7f18d89 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.110745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.111645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.111923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.112291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.112978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.114951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.123945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6651fec1209483f8200093a34cc7cc5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.136520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=4,keystone:SELECT=80,keystone:DELETE=16 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:01.137958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6651fec1209483f8200093a34cc7cc5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.145125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1286/2578] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:01.149311 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6651fec1209483f8200093a34cc7cc5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.149469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.150021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6651fec1209483f8200093a34cc7cc5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.150749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6651fec1209483f8200093a34cc7cc5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.151162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.166756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1293/2579] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:00 2022] DELETE /identity/v3/users/c6651fec1209483f8200093a34cc7cc5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:01.217298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3ab4-500c-48fe-a149-6f6cf4211e32 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.227026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:01.281324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.281974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.282283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.282565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.283235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.285466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.310575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1287/2580] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:01.311724 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.324387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c89dc-dc01-4d57-9a25-174b5337a1c5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.329976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.331222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.331651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.331925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.332598 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.334405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.345297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1294/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:01.349398 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.360134 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327626b-3fb9-4738-a652-6d1d3654e47f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.365439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.366058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.366658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.366940 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.367619 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.369214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599ff9-0571-4036-8852-54c66078a4eb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.380831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1288/2582] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:01.385416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.396895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3704-9307-4099-a5f8-f975a7ba77f8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.401577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.402334 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.402684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.403023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] PATH_INFO: `/v3/projects/055de6af56f949e1a326ec26738ae2ca/users/6f326d56f0444b269162466257ae8c49/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.419449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055de6af56f949e1a326ec26738ae2ca, user_id=6f326d56f0444b269162466257ae8c49, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.422379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.437677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1295/2583] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:01 2022] PUT /identity/v3/projects/055de6af56f949e1a326ec26738ae2ca/users/6f326d56f0444b269162466257ae8c49/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:01.449063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.449426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.449955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.452266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.454225 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.493591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] MFA Rules not processed for user `6f326d56f0444b269162466257ae8c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:01.494842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.525607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452d44-52fd-4530-8811-063392a03dc4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.530664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.531738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.531738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.531954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] PATH_INFO: `/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.533202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=88668ec4a49c4f56a1ea24e881ab8e53)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.535121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.568612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1289/2584] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:01.573060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.583795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9336f9-22ce-453d-bd69-3d9bf769e0b0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.584772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88668ec4a49c4f56a1ea24e881ab8e53', 'request_id': 'req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.591331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88668ec4a49c4f56a1ea24e881ab8e53', 'request_id': 'req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.597700 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88668ec4a49c4f56a1ea24e881ab8e53', 'request_id': 'req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.612162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] The token cache is being invalidate because project 88668ec4a49c4f56a1ea24e881ab8e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:01.612460 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.613127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f5c986cc-eb8d-47d5-93ee-2edca3bc29ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:01.614683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1296/2585] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:01 2022] DELETE /identity/v3/projects/88668ec4a49c4f56a1ea24e881ab8e53 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:01.620015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35de7-b6e6-414b-8102-84d902395983 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.620302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35de7-b6e6-414b-8102-84d902395983 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.620601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35de7-b6e6-414b-8102-84d902395983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.641940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ddb35de7-b6e6-414b-8102-84d902395983 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:01.643161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ddb35de7-b6e6-414b-8102-84d902395983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.645517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.646136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.646415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.646684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.647367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.649264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.651313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1297/2586] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:01.659887 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.660171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.660446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.680745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:01.681362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1290/2587] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:01.683931 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.685282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.686866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:01.695432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:01.710351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:01.752857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1298/2588] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:01.755277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3fb29-ac34-4f2d-abf3-67abaea22d67 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.757015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.760953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.761574 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.761931 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.762262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.763023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.765122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.766157 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d287-cd86-4818-9e7d-12c7a992e6c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.770857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.771484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.771764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.772038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.772687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:01.772985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.774605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.787758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1299/2589] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:29:01.789963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1291/2590] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:01.792248 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.794744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.802853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c89bd-4040-4b5a-bba4-ffa35aef8a4a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.805096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cbff-843c-4d15-b96d-92faaa1c5d0e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.807831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.808511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.808832 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.809176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.809764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.810717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.811359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.811662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.811781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.811926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.812553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.814444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.825534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1292/2591] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:01.829895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.841108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b3f-173f-494f-9592-2c607ed37672 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.845401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1300/2592] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:01.846725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.903897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.904559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.904831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.905103 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] PATH_INFO: `/v3/projects/02cd797e45b24b4c8b31e30b821b7b89/users/7bc809b368b244b0b07a82110f45b614/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.913253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfdc54-8676-45d2-b0a3-7ba1cce913df admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:01.917940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:01.918573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:01.918849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:01.919114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:01.919797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.920213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cd797e45b24b4c8b31e30b821b7b89, user_id=7bc809b368b244b0b07a82110f45b614, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:01.921756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.922877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:01.937829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1293/2593] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:01 2022] PUT /identity/v3/projects/02cd797e45b24b4c8b31e30b821b7b89/users/7bc809b368b244b0b07a82110f45b614/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:01.942086 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.945078 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1301/2594] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:01 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:01.949132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:01.959266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf0d3c-0ab5-405d-bf9f-a1b3be05d12f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.012694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240d1d-7cde-4aea-8604-79287f3f36eb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.018564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.019752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.020054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.020334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.021077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.022722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.034643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1294/2595] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:02.039237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.044968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.046198 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:02.047242 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.047605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.047972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.049281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.050994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.051150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3552-254d-4b2d-85c8-2103b4a2331b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.056823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.057769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.058523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.058886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] PATH_INFO: `/v3/projects/02cd797e45b24b4c8b31e30b821b7b89/users/7bc809b368b244b0b07a82110f45b614/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.061105 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cd797e45b24b4c8b31e30b821b7b89, user_id=7bc809b368b244b0b07a82110f45b614, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.063920 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695332f-e602-453b-adf6-89dd4bee68be admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.072715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1302/2596] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:02.073998 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.086926 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b9683-663e-4970-8684-74dcc94f66c0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.087120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1295/2597] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:02 2022] PUT /identity/v3/projects/02cd797e45b24b4c8b31e30b821b7b89/users/7bc809b368b244b0b07a82110f45b614/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:02.088850 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.089145 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.089424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.116537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:02.133314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] MFA Rules not processed for user `7bc809b368b244b0b07a82110f45b614`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:02.135122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.177185 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.177957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.178238 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.178532 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.179190 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.180867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.192092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1303/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:02.196378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.208556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21387-2358-412c-939d-ca959790e25d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.214766 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.215526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.215920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.216187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] PATH_INFO: `/v3/projects/d7e458e1dae14e0cae2b1c9b3ee02c34/users/af279a0304bc48ad8575d1fb38a9e716/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.224092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1296/2599] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:02.234834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e458e1dae14e0cae2b1c9b3ee02c34, user_id=af279a0304bc48ad8575d1fb38a9e716, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.236028 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.237977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.238094 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce3601-2015-4fda-aad4-17c7ab3545d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.255781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1304/2600] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:02 2022] PUT /identity/v3/projects/d7e458e1dae14e0cae2b1c9b3ee02c34/users/af279a0304bc48ad8575d1fb38a9e716/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:02.267002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.267352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.267635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.296901 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] MFA Rules not processed for user `af279a0304bc48ad8575d1fb38a9e716`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:02.298281 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.301974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5eb47-be54-4cf4-a9c7-84f2c8fd0660 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.354745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.355408 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.355684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.355957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.366144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1305/2601] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:02.371163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.401839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:02.421296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.422779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.433071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1297/2602] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:02.444439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15315b-2448-40ea-932d-d8a7aca96ac0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.449345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.450060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.450340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.450678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.451425 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.453464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.485441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.486971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.492746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1306/2603] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:02 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:02.496790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.502507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7690a-ed9b-4e84-b40d-546348c64c09 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.507927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:02.558911 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.559575 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.559837 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.560101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.562073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.572040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f81c-04fc-4d74-8ebb-1fd40a0ef9d6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.578246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.578973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.579424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.579973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.580765 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.582819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.610699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1307/2604] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:02 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:02.615396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.625748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b52d-e781-4b48-a74e-ab6cd2f062f1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.628526 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.630093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.632397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.633291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.633705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.634109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.635081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.637701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.639493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1298/2605] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:29:02.649295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1308/2606] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:02.653621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.665275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdd7d-4e26-46d9-8e5c-76ab6f4a5efe service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.670087 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.670814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.671119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.671422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] PATH_INFO: `/v3/projects/f0b4dd6623364b859438adf51ec536b0/users/8902b0c0298441fdb26a33c4bfe81b77/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.686801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b4dd6623364b859438adf51ec536b0, user_id=8902b0c0298441fdb26a33c4bfe81b77, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.689825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.705799 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1299/2607] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:02 2022] PUT /identity/v3/projects/f0b4dd6623364b859438adf51ec536b0/users/8902b0c0298441fdb26a33c4bfe81b77/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:02.709915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.720797 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e9d6-b813-4c3e-9262-f5b7ed2d4c5f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.783523 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.784207 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.784494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.784791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.785439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.787071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24951c-52d0-473f-a7d6-760498417d90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.797809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1309/2608] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:02.802625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:02.813909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6c0f-cab2-41bc-a941-8ef009fe5f23 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:02.819476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:02.820163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.820435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.820699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] PATH_INFO: `/v3/projects/f0b4dd6623364b859438adf51ec536b0/users/8902b0c0298441fdb26a33c4bfe81b77/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.822674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b4dd6623364b859438adf51ec536b0, user_id=8902b0c0298441fdb26a33c4bfe81b77, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:02.825325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:02.836020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1300/2609] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:02 2022] PUT /identity/v3/projects/f0b4dd6623364b859438adf51ec536b0/users/8902b0c0298441fdb26a33c4bfe81b77/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:02.847704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:02.847984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:02.848264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:02.877437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] MFA Rules not processed for user `8902b0c0298441fdb26a33c4bfe81b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:02.878695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:02.956227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1310/2610] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:02.968301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:03.040747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483462-217b-4f3d-a090-622fa883933d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:03.044555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:03.045517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:03.045950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:03.046370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:03.060405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:03.062460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3fd77-38bf-4cbf-a99a-327c6ca0b69a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:03.072431 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1301/2611] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:03.844616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:03.856201 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:03.917371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6d7a-b280-470e-a197-a16bdbfab229 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:03.922343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:03.922980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:03.923266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:03.923536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] PATH_INFO: `/v3/users/af279a0304bc48ad8575d1fb38a9e716` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:03.924837 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af279a0304bc48ad8575d1fb38a9e716)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:03.927001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:03.980010 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af279a0304bc48ad8575d1fb38a9e716'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:03.994845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af279a0304bc48ad8575d1fb38a9e716'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.004025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af279a0304bc48ad8575d1fb38a9e716'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.004845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af279a0304bc48ad8575d1fb38a9e716'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.005470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af279a0304bc48ad8575d1fb38a9e716'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.023719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1311/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:03 2022] DELETE /identity/v3/users/af279a0304bc48ad8575d1fb38a9e716 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:04.028362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:04.028881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:04.028977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:04.036805 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:04.057540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:04.058771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:04.130744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1302/2613] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:04.138647 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:04.140677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:04.143129 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:04.145658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:04.222194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381014-9a5e-4185-9d80-a5c4f72e7a57 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:04.227733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:04.228775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:04.229169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:04.229552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:04.240639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:04.242544 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:04.249529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a028-df64-49b3-882e-1a3a885fb809 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:04.253542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1303/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:04.256428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:04.257325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:04.257444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:04.257625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:04.259664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:04.278045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:04.280048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:04.292028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1312/2615] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:04.696131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:04.697754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:04.716470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f113-1841-466b-8ff2-11b94eb8fe62 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:04.721866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:04.722592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:04.722871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:04.723137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] PATH_INFO: `/v3/projects/d7e458e1dae14e0cae2b1c9b3ee02c34` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:04.724433 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e458e1dae14e0cae2b1c9b3ee02c34)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:04.726505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:04.779683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e458e1dae14e0cae2b1c9b3ee02c34', 'request_id': 'req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.788656 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e458e1dae14e0cae2b1c9b3ee02c34', 'request_id': 'req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.794289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e458e1dae14e0cae2b1c9b3ee02c34', 'request_id': 'req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.805401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] The token cache is being invalidate because project d7e458e1dae14e0cae2b1c9b3ee02c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:04.805701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.806374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.807947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1304/2616] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:04 2022] DELETE /identity/v3/projects/d7e458e1dae14e0cae2b1c9b3ee02c34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:04.812280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:04.822965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399735-3347-4a84-be2d-9df9ae460bbd service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:04.830524 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:04.883309 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:04.884003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:04.884259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:04.884550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] PATH_INFO: `/v3/users/8902b0c0298441fdb26a33c4bfe81b77` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:04.885703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8902b0c0298441fdb26a33c4bfe81b77)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:04.887706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:04.941395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8902b0c0298441fdb26a33c4bfe81b77'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.954759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8902b0c0298441fdb26a33c4bfe81b77'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.962448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8902b0c0298441fdb26a33c4bfe81b77'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.963261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8902b0c0298441fdb26a33c4bfe81b77'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.963899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4057061a-1227-4e99-80cf-ac263c092e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8902b0c0298441fdb26a33c4bfe81b77'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:04.981038 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1313/2617] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:04 2022] DELETE /identity/v3/users/8902b0c0298441fdb26a33c4bfe81b77 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:05.281312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.282848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.298791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4391fd-dbfd-4b51-bbee-555d1e293a4e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.329427 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:05.368869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.369528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.369792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.370057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] PATH_INFO: `/v3/projects/f0b4dd6623364b859438adf51ec536b0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.371278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b4dd6623364b859438adf51ec536b0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.373256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.428062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b4dd6623364b859438adf51ec536b0', 'request_id': 'req-759cf5fc-b33c-4621-b7a3-2007d2b62f93'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.437937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b4dd6623364b859438adf51ec536b0', 'request_id': 'req-759cf5fc-b33c-4621-b7a3-2007d2b62f93'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.443949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b4dd6623364b859438adf51ec536b0', 'request_id': 'req-759cf5fc-b33c-4621-b7a3-2007d2b62f93'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.457476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] The token cache is being invalidate because project f0b4dd6623364b859438adf51ec536b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:05.457684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.458323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-759cf5fc-b33c-4621-b7a3-2007d2b62f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.460185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1305/2618] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:05 2022] DELETE /identity/v3/projects/f0b4dd6623364b859438adf51ec536b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:05.465287 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.465572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.465922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.487115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:05.488382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.552680 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1314/2619] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:05.560649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.560925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.561194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.582137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:05.583524 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.592494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1306/2620] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:05.597548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.609706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfd9b-0ff0-4830-b0cb-bfe20aa6d7b0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.615908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.616875 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.617149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.617403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.618057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:05.618347 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.619989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfd999-3472-4de4-b16a-bd4a95140e6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.635669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1315/2621] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:29:05.639760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.660217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c78d-7015-43e7-9690-25d14357407a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.665023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.665316 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.665583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.665828 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.666463 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.666751 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.667021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.667690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.669699 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.690170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] MFA Rules not processed for user `837c4c6e2f1743eabe53bf75e01bab1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:05.692881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.710404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1307/2622] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:05.711618 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.713714 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:05.714126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.769307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1316/2623] 10.222.0.26 () {58 vars in 967 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:05.770052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.783663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f6fcb-5b86-410c-9e92-c4acf4058595 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.803191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77c9e-b4cb-4b9e-9026-91ea2d2a666d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.808381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.809695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.809966 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.810277 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] PATH_INFO: `/v3/users/6f619e4c213f427997765cdfb441e9d6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.811858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f619e4c213f427997765cdfb441e9d6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.814255 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.854040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.854663 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.854942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.855256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.855878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.856295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:05.857900 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.875114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f619e4c213f427997765cdfb441e9d6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.885529 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1317/2624] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:05.886279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f619e4c213f427997765cdfb441e9d6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.886567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.888275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.894454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f619e4c213f427997765cdfb441e9d6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.895170 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f619e4c213f427997765cdfb441e9d6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.907642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f619e4c213f427997765cdfb441e9d6'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:05.913958 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1308/2625] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:05 2022] DELETE /identity/v3/users/6f619e4c213f427997765cdfb441e9d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:05.917106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:05.917106 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:05.963318 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740f05-9afa-4a44-ae2e-d043fbae8fdf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.980160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f29b-e4e1-4306-ad88-7a937642a16a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:05.984921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:05.985559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:05.985823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:05.986092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:05.986738 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:05.988560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f912-7305-40c7-a6d7-b4cae338c2d8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:05.999329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1309/2626] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:06.002857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.002857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.002857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.018090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:06.020067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:06.021379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.029113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1310/2627] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:06.029346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7c13d179cf442999070e1e0d1cf89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.029925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.030101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.030284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.030560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.036330 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.041744 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4be1-5270-459c-96e8-774f81d0a787 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.046345 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.046942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.047238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.047511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.048153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.049739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.060666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1311/2628] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:06.061472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.063053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.099027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.100691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.109495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1318/2629] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Sep 2 05:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 05:29:06.110152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.120935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5957-a40a-44fc-8207-425862556e40 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.124449 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878db77-b4c7-47c5-9b35-e87952bb179a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.125722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.126408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.126687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.126962 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] PATH_INFO: `/v3/projects/d8709101d71f4f878c841e8e5a790d43/users/b7c3e91b1e8c43ecbac576a4ce34122b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.128518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.129151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.129432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.129702 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.140071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.143725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ebb95-96d2-43c7-832d-c23cb36c8d7a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.143847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8709101d71f4f878c841e8e5a790d43, user_id=b7c3e91b1e8c43ecbac576a4ce34122b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.146711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.159396 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1312/2630] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:06.175294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1319/2631] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:06 2022] PUT /identity/v3/projects/d8709101d71f4f878c841e8e5a790d43/users/b7c3e91b1e8c43ecbac576a4ce34122b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:06.179825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.180146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.180469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.226197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] MFA Rules not processed for user `b7c3e91b1e8c43ecbac576a4ce34122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:06.227340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.252217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:06.308623 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1313/2632] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:06.313742 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.405285 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68379d-d156-4b98-9693-cda1b28f0a09 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.410209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.410872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.411300 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.412085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.412363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.414762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.457222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1320/2633] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:06 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:06.461980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.478569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e60f-9f2d-4339-8487-d0d5191d68ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.479810 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.481757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.567386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.568851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.569169 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.569559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.570299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.572370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.583509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:06.587757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d73fdf-a300-4d4f-955e-d7f245629de6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.593421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.594081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.594537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.595034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] PATH_INFO: `/v3/projects/23e6c234a3fc45d290b4379dc9ac8edb` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.596279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e6c234a3fc45d290b4379dc9ac8edb)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.596413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1314/2634] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:06 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:06.598525 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.600561 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.610571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b7dd-7b2b-46f4-b1ef-116bc0fc0a2a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.615724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.616681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.616971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.617247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.617908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.619547 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.631271 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1315/2635] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:06.636511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.647520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e0c7-5b63-451f-b6fd-037e10c35caa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.651474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e6c234a3fc45d290b4379dc9ac8edb', 'request_id': 'req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.660124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e6c234a3fc45d290b4379dc9ac8edb', 'request_id': 'req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.666985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e6c234a3fc45d290b4379dc9ac8edb', 'request_id': 'req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.682262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] The token cache is being invalidate because project 23e6c234a3fc45d290b4379dc9ac8edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:06.682619 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.683390 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.685340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1321/2636] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:06 2022] DELETE /identity/v3/projects/23e6c234a3fc45d290b4379dc9ac8edb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:06.689110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.691125 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.720258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.722511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.723322 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.723857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] PATH_INFO: `/v3/projects/353a73f4780f43cba8a85206e5641707/users/c39d02c73d254c8b99e2075ed4bce7df/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.744640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353a73f4780f43cba8a85206e5641707, user_id=c39d02c73d254c8b99e2075ed4bce7df, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.747373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.761961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1316/2637] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:06 2022] PUT /identity/v3/projects/353a73f4780f43cba8a85206e5641707/users/c39d02c73d254c8b99e2075ed4bce7df/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:06.763495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaefe7-a1f2-459f-a52b-00c59f53b9c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.765939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.767628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:06.792515 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:06.824362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.825066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.825345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.825617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] PATH_INFO: `/v3/users/6f326d56f0444b269162466257ae8c49` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.826772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f326d56f0444b269162466257ae8c49)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.828776 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.832772 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56a8cf-cbb5-4e53-be9d-03d0db827281 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.837950 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.838572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.838832 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.839090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.839795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.841393 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.851989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1317/2638] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:06.856057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:06.866633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc86a-d44a-46b2-a8d0-1976b0b80f10 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:06.870475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:06.871313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:06.871955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.872239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.872500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] PATH_INFO: `/v3/projects/353a73f4780f43cba8a85206e5641707/users/c39d02c73d254c8b99e2075ed4bce7df/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.874483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353a73f4780f43cba8a85206e5641707, user_id=c39d02c73d254c8b99e2075ed4bce7df, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:06.877237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff1ed-c571-41ad-b310-98337ab7c905 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:06.881453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f326d56f0444b269162466257ae8c49'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.888056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1318/2639] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:06 2022] PUT /identity/v3/projects/353a73f4780f43cba8a85206e5641707/users/c39d02c73d254c8b99e2075ed4bce7df/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:06.894255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f326d56f0444b269162466257ae8c49'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.900003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:06.900290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:06.900687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:06.903340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f326d56f0444b269162466257ae8c49'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.904228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f326d56f0444b269162466257ae8c49'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.904942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f326d56f0444b269162466257ae8c49'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:06.921559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1322/2640] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:06 2022] DELETE /identity/v3/users/6f326d56f0444b269162466257ae8c49 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:06.931804 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] MFA Rules not processed for user `c39d02c73d254c8b99e2075ed4bce7df`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:06.933161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:07.007673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1319/2641] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:07.019397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:07.020994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:07.081295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ad44-7415-469f-9042-69e014bec96e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:07.085140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:07.085857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:07.086212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:07.086517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:07.088420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:07.169271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:07.170786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:07.180434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1323/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:07.288961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:07.291266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:07.369434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510d3ee-b807-4a65-9846-32adbf69c8c4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:07.376040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:07.377261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:07.377675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:07.377960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] PATH_INFO: `/v3/projects/055de6af56f949e1a326ec26738ae2ca` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:07.379175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=055de6af56f949e1a326ec26738ae2ca)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:07.381328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:07.419355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:07.433443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055de6af56f949e1a326ec26738ae2ca', 'request_id': 'req-2845d80c-a2c1-49c3-93b9-81968de84d7d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.441448 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055de6af56f949e1a326ec26738ae2ca', 'request_id': 'req-2845d80c-a2c1-49c3-93b9-81968de84d7d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.447917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055de6af56f949e1a326ec26738ae2ca', 'request_id': 'req-2845d80c-a2c1-49c3-93b9-81968de84d7d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.461130 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] The token cache is being invalidate because project 055de6af56f949e1a326ec26738ae2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:07.461306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.461978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.463809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1320/2643] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:07 2022] DELETE /identity/v3/projects/055de6af56f949e1a326ec26738ae2ca => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:07.467974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:07.479690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc68d-7482-4590-9ac7-f55df73ba9f3 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:07.549845 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:07.551444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:07.551674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:07.551925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] PATH_INFO: `/v3/users/7bc809b368b244b0b07a82110f45b614` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:07.555895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc809b368b244b0b07a82110f45b614)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:07.557995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:07.571594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:07.611943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc809b368b244b0b07a82110f45b614'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.625093 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc809b368b244b0b07a82110f45b614'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.632759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc809b368b244b0b07a82110f45b614'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.633485 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc809b368b244b0b07a82110f45b614'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.634090 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-21601958-8efd-49f5-ad8c-92be7eccc80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc809b368b244b0b07a82110f45b614'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:07.648579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1324/2644] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:07 2022] DELETE /identity/v3/users/7bc809b368b244b0b07a82110f45b614 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:08.208318 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.209886 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:08.227452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845d80c-a2c1-49c3-93b9-81968de84d7d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.289391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.290021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.290296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.290560 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] PATH_INFO: `/v3/projects/02cd797e45b24b4c8b31e30b821b7b89` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.291733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cd797e45b24b4c8b31e30b821b7b89)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.293631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.344323 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cd797e45b24b4c8b31e30b821b7b89', 'request_id': 'req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:08.352870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cd797e45b24b4c8b31e30b821b7b89', 'request_id': 'req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:08.359253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cd797e45b24b4c8b31e30b821b7b89', 'request_id': 'req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:08.372601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] The token cache is being invalidate because project 02cd797e45b24b4c8b31e30b821b7b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:08.373195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:08.373635 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-bcd24d05-5bbc-4e2b-91b2-aaf0248cb9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:08.375961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1321/2645] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:08 2022] DELETE /identity/v3/projects/02cd797e45b24b4c8b31e30b821b7b89 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:08.382722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.383211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.383211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.403792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:08.404964 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:08.483537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1325/2646] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:08.493669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.493979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.494253 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.521849 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:08.523798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:08.536906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1322/2647] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:08.541481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.552683 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b835-7592-4d18-a8d3-99c808f043c1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.558786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.559436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.559708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.559976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.560630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:08.560925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.562548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.576596 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1326/2648] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:29:08.581119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.591439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd99445-74d4-48cf-8c4d-5ac434444275 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.596254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.596875 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.597218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.598155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.598801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.600754 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.636606 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1323/2649] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:08 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:08.637351 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.648151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5f55-6fcc-4701-9d3c-296b084e2bf0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.712482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.713120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.713399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.713653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.714314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.716454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.745956 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1327/2650] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:08 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:08.748881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.760827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4648a-efd7-44ba-8919-02b8ed5d1b3b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.766041 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.766703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.766979 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.767278 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.767938 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.769709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.781601 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1324/2651] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:08.786228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.794371 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:08.798140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8e3d-2f6e-4338-944c-989747a1c297 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.805294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.806149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.806436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.807451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.808572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.810581 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3b97b-49fd-438e-91a6-a6d25b93c018 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.827772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1328/2652] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:08.829188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:08.841663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc475a-a78a-48e4-b803-c212e18e1ea7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:08.846466 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:08.847178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.847504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.847790 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] PATH_INFO: `/v3/projects/e6b5befd8c124f1b96c3609c0d39b841/users/a5918596c6944bf18a9895745b9f8a09/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.858775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:08.867913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b5befd8c124f1b96c3609c0d39b841, user_id=a5918596c6944bf18a9895745b9f8a09, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:08.872220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:08.887769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1325/2653] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:08 2022] PUT /identity/v3/projects/e6b5befd8c124f1b96c3609c0d39b841/users/a5918596c6944bf18a9895745b9f8a09/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:08.900002 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:08.900548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:08.900808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:08.932134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] MFA Rules not processed for user `a5918596c6944bf18a9895745b9f8a09`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:08.933391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:09.002395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1329/2654] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:09.007608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.081528 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23264-a348-4309-8d81-879b9a560d1f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.089840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.090607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.090891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.091381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.092071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.094366 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.128585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1326/2655] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:09 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:09.135226 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.146402 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934e11-773a-4e94-bd74-477a9cb2df1a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.211325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.211951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.212228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.212493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.213130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.215079 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.242447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1330/2656] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:09 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:09.243885 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.254996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0ad00-caa1-4e1b-8bc2-8332a61e4966 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.259764 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.260402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.260682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.260963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.261610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.263279 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.274030 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1327/2657] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:09.278247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.289098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6653-c159-4b94-b03b-957516a9fc0e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.295086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.295770 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.296043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.297105 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] PATH_INFO: `/v3/projects/520cef77139a44769d0ad7e210602b1f/users/03ab5d04bc6f4be2ba7bb8cee8823b75/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.313760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520cef77139a44769d0ad7e210602b1f, user_id=03ab5d04bc6f4be2ba7bb8cee8823b75, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.316508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.332989 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1331/2658] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:09 2022] PUT /identity/v3/projects/520cef77139a44769d0ad7e210602b1f/users/03ab5d04bc6f4be2ba7bb8cee8823b75/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:09.337238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.348127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbdff-7974-4f84-bf4e-ea4dee46f1b2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.407733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.408407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.408597 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.408863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.409498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.411141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c44a8-ff99-453a-993d-8f6177317c22 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.420907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1328/2659] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:09.425457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.435878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84de67-3922-40ab-8053-734a75c0b512 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.440669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.441313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.441613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.441876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] PATH_INFO: `/v3/projects/520cef77139a44769d0ad7e210602b1f/users/03ab5d04bc6f4be2ba7bb8cee8823b75/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.443823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520cef77139a44769d0ad7e210602b1f, user_id=03ab5d04bc6f4be2ba7bb8cee8823b75, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.446464 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.457001 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1332/2660] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:09 2022] PUT /identity/v3/projects/520cef77139a44769d0ad7e210602b1f/users/03ab5d04bc6f4be2ba7bb8cee8823b75/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:09.467851 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.468133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.468411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.499114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] MFA Rules not processed for user `03ab5d04bc6f4be2ba7bb8cee8823b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:09.500334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:09.545065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:09.572955 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1329/2661] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:09.585740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.587735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:09.631723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:09.650872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ca9a4-2c2c-410c-8d90-0903d242ddd3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.654934 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.655584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.655860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.656127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.666236 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.667784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.677611 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1333/2662] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:09.770825 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:09.783662 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18b04a-e012-4496-9506-f93f48ecd6bb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:09.787705 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:09.788328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:09.788607 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:09.788877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:09.848895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:09.850342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:09.859369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1330/2663] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:11.648655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:11.650237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:11.662132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a812-f3cf-47df-94aa-1c0e5b8611e0 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:11.665933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:11.666559 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:11.666844 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:11.667124 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:11.668867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:11.734520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:11.736058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce321-e191-4ae9-a1fc-6e60bb50cd28 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:11.746277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1334/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:14.732715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:14.798218 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7df94-bf72-4707-987d-a5197f94ae7a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:14.804208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:14.804830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:14.805108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:14.805374 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] PATH_INFO: `/v3/users/a5918596c6944bf18a9895745b9f8a09` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:14.806663 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5918596c6944bf18a9895745b9f8a09)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:14.808730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:14.860972 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5918596c6944bf18a9895745b9f8a09'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:14.875070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5918596c6944bf18a9895745b9f8a09'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:14.887458 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5918596c6944bf18a9895745b9f8a09'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:14.888593 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5918596c6944bf18a9895745b9f8a09'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:14.903339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5918596c6944bf18a9895745b9f8a09'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:14.906496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:14.911683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1331/2665] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:14 2022] DELETE /identity/v3/users/a5918596c6944bf18a9895745b9f8a09 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:14.916484 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:14.917035 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:14.917134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:14.943637 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:14.945132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:15.011506 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1335/2666] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:15.021895 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:15.023529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:15.094131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97abc9-4d2d-47de-a2ee-6b355ece4613 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:15.098496 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:15.099148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:15.099535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:15.099848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:15.109470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:15.110921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:15.121317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1332/2667] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:15.411780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:15.412975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:15.425405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fbf1f-3f76-445a-a1fa-5634b0f9d93c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:15.431271 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:15.432073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:15.432346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:15.432613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] PATH_INFO: `/v3/projects/e6b5befd8c124f1b96c3609c0d39b841` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:15.433778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b5befd8c124f1b96c3609c0d39b841)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:15.435753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:15.484030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b5befd8c124f1b96c3609c0d39b841', 'request_id': 'req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.490519 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b5befd8c124f1b96c3609c0d39b841', 'request_id': 'req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.497455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b5befd8c124f1b96c3609c0d39b841', 'request_id': 'req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.502367 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:15.519359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] The token cache is being invalidate because project e6b5befd8c124f1b96c3609c0d39b841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:15.519705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.520562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.522143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1336/2668] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:15 2022] DELETE /identity/v3/projects/e6b5befd8c124f1b96c3609c0d39b841 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:15.526325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:15.536419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56a534-f270-4129-aff0-713832d584f2 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:15.601363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:15.602038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:15.602382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:15.602632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] PATH_INFO: `/v3/users/03ab5d04bc6f4be2ba7bb8cee8823b75` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:15.603779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ab5d04bc6f4be2ba7bb8cee8823b75)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:15.605726 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:15.658068 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ab5d04bc6f4be2ba7bb8cee8823b75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.667191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ab5d04bc6f4be2ba7bb8cee8823b75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.674933 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ab5d04bc6f4be2ba7bb8cee8823b75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.675644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ab5d04bc6f4be2ba7bb8cee8823b75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.687868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-50fa6ee3-4791-489b-805d-20cb70fec73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ab5d04bc6f4be2ba7bb8cee8823b75'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:15.694248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1333/2669] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:15 2022] DELETE /identity/v3/users/03ab5d04bc6f4be2ba7bb8cee8823b75 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:15.984935 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:15.986449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.006256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fa2a6-7162-43ea-a56d-9a6caf4a001a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.067458 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.068101 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.068378 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.068651 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] PATH_INFO: `/v3/projects/520cef77139a44769d0ad7e210602b1f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.069785 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520cef77139a44769d0ad7e210602b1f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.071780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.134786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520cef77139a44769d0ad7e210602b1f', 'request_id': 'req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.142141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520cef77139a44769d0ad7e210602b1f', 'request_id': 'req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.149579 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520cef77139a44769d0ad7e210602b1f', 'request_id': 'req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.164096 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] The token cache is being invalidate because project 520cef77139a44769d0ad7e210602b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:16.164383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.165006 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd6605dc-bc0a-4d63-b72e-ca1d912490a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.166509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1337/2670] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:15 2022] DELETE /identity/v3/projects/520cef77139a44769d0ad7e210602b1f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:16.171568 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.172078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.172078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.192307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:16.193529 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.215138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:16.267017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1334/2671] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:16.275597 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.275888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.276162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.296515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:16.297649 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.306961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1338/2672] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:16.310879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.321549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea885-606c-42a9-ae08-d86bcfd3c31d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.326946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.327715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.327995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.328287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.328961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:16.329259 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.330913 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.343960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1335/2673] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:29:16.349075 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.358809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b25e55-ef0a-4b36-8c4f-bc9748e2be98 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.364394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.365004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.365277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.365552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.366511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.368491 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.398421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1339/2674] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:16.402773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.413816 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea46de-40b1-4ae8-b2c3-7d79f1d6ffcf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.495631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.496249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.496531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.496796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.497423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.499439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.529231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1336/2675] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:16.530599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.541719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb604-6d4b-41d0-9250-9a308f6c6a82 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.546387 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.546997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.547299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.547567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.548211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.550188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.562470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1340/2676] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:16.566589 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.577280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66e39a-3a31-4ee7-82a9-97147bd3b011 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.581909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.582628 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.583141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.583460 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.584119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.585697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1ca0d-13b9-49cc-a7a1-beaf8d7ad9b5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.596641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1337/2677] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:16.601070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.611910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775278-394c-4ab4-8046-85ba2ab871f0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.617632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.618283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.618557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.618822 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] PATH_INFO: `/v3/projects/004731b3927041a7befe369552b5fbcf/users/9ae6b002250b4d72a8c8a37b29822d81/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.634270 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004731b3927041a7befe369552b5fbcf, user_id=9ae6b002250b4d72a8c8a37b29822d81, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.637083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.652366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1341/2678] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:16 2022] PUT /identity/v3/projects/004731b3927041a7befe369552b5fbcf/users/9ae6b002250b4d72a8c8a37b29822d81/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:16.663506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.663792 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.664063 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.694948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] MFA Rules not processed for user `9ae6b002250b4d72a8c8a37b29822d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:16.696202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.702388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.704218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.730476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:16.765868 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1338/2679] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:16.770384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.772212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd52a-e3a1-4d75-b6eb-8831fe4833d1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.776968 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.777608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.777873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.778140 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] PATH_INFO: `/v3/users/b7c3e91b1e8c43ecbac576a4ce34122b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.779283 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c3e91b1e8c43ecbac576a4ce34122b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.781210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.781349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bad1fd-6640-4571-aa44-2881f3087425 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.786400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.787021 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.787365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.787642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.788282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.790180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.807076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:16.821877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1339/2680] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:16.826058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.830382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c3e91b1e8c43ecbac576a4ce34122b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.845260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c3e91b1e8c43ecbac576a4ce34122b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.853343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c3e91b1e8c43ecbac576a4ce34122b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.854216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c3e91b1e8c43ecbac576a4ce34122b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.854953 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d4eaee45-7945-4795-865b-a17ac73d8c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c3e91b1e8c43ecbac576a4ce34122b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:16.868061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1342/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:16 2022] DELETE /identity/v3/users/b7c3e91b1e8c43ecbac576a4ce34122b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:16.872418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.872693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.872999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.892531 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef9aa2-485d-4792-b22f-c5870131d220 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:16.892872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:16.894088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.950295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:16.950908 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:16.951180 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:16.951486 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:16.952113 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:16.953072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1343/2682] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:16.957262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:16.962948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.964394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.982248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1340/2683] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:16 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:16.986156 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:16.987785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:16.999691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502124c-d2e8-4c03-a31d-8ea2c2ab8d09 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.005581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.006181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.006450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.006713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.007377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.008953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.013691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:17.020483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1341/2684] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:17.024625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.028324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c6188-268a-4c41-9417-12847d2fecae None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.033940 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.034551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.034795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be61ce2-09e0-46ce-8f6a-618c4b25dddc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.034908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.035084 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.039476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.040062 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.040337 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.040604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.041234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.042969 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.047067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.049072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff78d4-16bd-47d7-920b-b28cf637899c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.054057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1342/2685] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:17.058096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.061030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1344/2686] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:29:17.068287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c6a9a-1c7c-407c-bc40-3f4c8e4e580c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.072894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.073551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.073823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.074101 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] PATH_INFO: `/v3/projects/12f6c810b6d748638827b0038f7854b7/users/e46a8506e6224581b3f1d0ca0fad7b4b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.090331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f6c810b6d748638827b0038f7854b7, user_id=e46a8506e6224581b3f1d0ca0fad7b4b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.093470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.123231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1343/2687] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:17 2022] PUT /identity/v3/projects/12f6c810b6d748638827b0038f7854b7/users/e46a8506e6224581b3f1d0ca0fad7b4b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:17.180380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.180669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.180976 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.208543 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] MFA Rules not processed for user `e46a8506e6224581b3f1d0ca0fad7b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:17.209749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.275635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1345/2688] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:17.280191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.333247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:17.349928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9925-3e46-4df7-897d-57672442c755 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.352542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.354277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.356587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.357312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.357514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.357771 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.358839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.360461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.371227 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53faec7-958e-4bc2-841c-94e746d33f72 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.383768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.384477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.384738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.385062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] PATH_INFO: `/v3/projects/d8709101d71f4f878c841e8e5a790d43` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.386267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8709101d71f4f878c841e8e5a790d43)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.388328 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.403495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1344/2689] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:17 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:17.405354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.437756 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8709101d71f4f878c841e8e5a790d43', 'request_id': 'req-c862e6f6-72bc-43ab-aee5-890e5cea97c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.444753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8709101d71f4f878c841e8e5a790d43', 'request_id': 'req-c862e6f6-72bc-43ab-aee5-890e5cea97c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.451230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8709101d71f4f878c841e8e5a790d43', 'request_id': 'req-c862e6f6-72bc-43ab-aee5-890e5cea97c0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.465449 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] The token cache is being invalidate because project d8709101d71f4f878c841e8e5a790d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:17.467957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.468658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.470408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1346/2690] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:17 2022] DELETE /identity/v3/projects/d8709101d71f4f878c841e8e5a790d43 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:17.474276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6cff0-908f-4033-a58d-cb3800e5acc8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.475360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.476814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.537498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.538195 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.538409 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.538720 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.539314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.541241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.545540 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:17.549379 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862e6f6-72bc-43ab-aee5-890e5cea97c0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.556629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.557381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.557671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.558261 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] PATH_INFO: `/v3/users/c39d02c73d254c8b99e2075ed4bce7df` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.560258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39d02c73d254c8b99e2075ed4bce7df)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.562335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.567991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1345/2691] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:17 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:17.571888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.573840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.588823 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326713-6aaa-471d-8e55-d58d76fb92e8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.595672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.596191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.596488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.596746 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.597429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.599295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.612342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1346/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:17.617453 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.627475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39d02c73d254c8b99e2075ed4bce7df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.629228 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d0bd5-0385-4232-99f3-dc0c96fc6cbc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.635773 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.636439 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.636713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.636980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] PATH_INFO: `/v3/projects/c09534320323498390c6935754193e6b/users/798eb0e30c1a45d5b1b8c98f121c93a5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.644698 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39d02c73d254c8b99e2075ed4bce7df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.653239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39d02c73d254c8b99e2075ed4bce7df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.653941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39d02c73d254c8b99e2075ed4bce7df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.654112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09534320323498390c6935754193e6b, user_id=798eb0e30c1a45d5b1b8c98f121c93a5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.654696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39d02c73d254c8b99e2075ed4bce7df'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:17.656910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.671382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1347/2693] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:17 2022] DELETE /identity/v3/users/c39d02c73d254c8b99e2075ed4bce7df => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:17.677641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1347/2694] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:17 2022] PUT /identity/v3/projects/c09534320323498390c6935754193e6b/users/798eb0e30c1a45d5b1b8c98f121c93a5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:17.687114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.688573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.761307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2458a9-5d68-4489-876d-4d243790cedc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.766295 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.766945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.767239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.767510 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.768177 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.769819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719c69b-04ad-4675-8e09-46b4380f2c99 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.781369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1348/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:17.785883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.829694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:17.860667 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033d38d-44e6-436c-8a3d-f409a50a029b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:17.865543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:17.866587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.866863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.867133 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] PATH_INFO: `/v3/projects/c09534320323498390c6935754193e6b/users/798eb0e30c1a45d5b1b8c98f121c93a5/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.869084 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09534320323498390c6935754193e6b, user_id=798eb0e30c1a45d5b1b8c98f121c93a5, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:17.871839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:17.882994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1348/2696] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:17 2022] PUT /identity/v3/projects/c09534320323498390c6935754193e6b/users/798eb0e30c1a45d5b1b8c98f121c93a5/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:17.893196 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:17.893481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:17.893753 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:17.924111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] MFA Rules not processed for user `798eb0e30c1a45d5b1b8c98f121c93a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:17.925343 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:17.953472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:17.955842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.014918 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:18.021000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1349/2697] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:18.032087 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.032624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce8a7-f649-4725-a36e-d8bef92cd841 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.033542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.038417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.039356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.039631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.039896 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] PATH_INFO: `/v3/projects/353a73f4780f43cba8a85206e5641707` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.041127 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353a73f4780f43cba8a85206e5641707)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.043055 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.090394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a664c8-7672-491d-8aaa-e78d7b80d7a0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.091562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353a73f4780f43cba8a85206e5641707', 'request_id': 'req-a9860f9a-f4ca-40d0-b12b-aad69a18c666'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:18.100502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353a73f4780f43cba8a85206e5641707', 'request_id': 'req-a9860f9a-f4ca-40d0-b12b-aad69a18c666'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:18.106077 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353a73f4780f43cba8a85206e5641707', 'request_id': 'req-a9860f9a-f4ca-40d0-b12b-aad69a18c666'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:18.118162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] The token cache is being invalidate because project 353a73f4780f43cba8a85206e5641707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:18.118369 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:18.119047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9860f9a-f4ca-40d0-b12b-aad69a18c666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:18.120563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1349/2698] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:17 2022] DELETE /identity/v3/projects/353a73f4780f43cba8a85206e5641707 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:18.126388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796987ef-baf5-43e2-80f7-8fcabb507488 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.126735 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796987ef-baf5-43e2-80f7-8fcabb507488 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.127067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796987ef-baf5-43e2-80f7-8fcabb507488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.142325 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.143015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.143294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.143558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.145388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.147328 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-796987ef-baf5-43e2-80f7-8fcabb507488 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:18.148511 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-796987ef-baf5-43e2-80f7-8fcabb507488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.197846 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:18.207053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.208867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.216595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1350/2699] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:18.218111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.218247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1350/2700] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:29:18.218454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.218732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.238737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:18.240179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.248421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1351/2701] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:18.252892 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.264068 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03461d-956a-4fbc-9176-1e110e2090b9 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.268675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.269296 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.269578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.269889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.270628 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:18.270853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.272685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.287232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1351/2702] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 05:29:18.289666 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.299066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8b34-b70d-4aa5-af36-e56a1c70adcb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.304925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.305687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.306059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.306334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.307040 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.309091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.339487 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1352/2703] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:18 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:18.344218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.354588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2cc8a-91a9-4749-876d-54a9107d51d8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.409601 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:18.417826 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.418475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.418755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.419027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.419694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.421644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.445032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1352/2704] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:18 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:18.449501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.460586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aae72-b041-44cf-866d-17a5fc04dd81 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.466047 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.466775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.467173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.467584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.468355 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.470036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.481165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1353/2705] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:18.485514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.503732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbebdfb-55d1-4644-a436-8b2adf30f3d4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.509239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.510061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.510346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.510885 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.511373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.513074 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57882125-c5ac-4b08-80d6-4365acb8829d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.525733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1353/2706] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:18.530079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.540732 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3719-6ac5-4b18-bac1-fb4adc0f2b99 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.545689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.546481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.546873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.547587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] PATH_INFO: `/v3/projects/df3f065176f6428caca6dfbf6d6609f0/users/af7b0de880ac4ad3bfe7fd577cad55fb/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.572708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3f065176f6428caca6dfbf6d6609f0, user_id=af7b0de880ac4ad3bfe7fd577cad55fb, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.575386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.591251 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1354/2707] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:18 2022] PUT /identity/v3/projects/df3f065176f6428caca6dfbf6d6609f0/users/af7b0de880ac4ad3bfe7fd577cad55fb/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:18.603455 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.603734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.604017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.636426 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] MFA Rules not processed for user `af7b0de880ac4ad3bfe7fd577cad55fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:18.637643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.706754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1354/2708] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:18.718684 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:18.720796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:18.785247 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb109d-4069-4105-99d8-fad4c25786aa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:18.789404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd812f7fb4e114ae4ab5d7c2a111df3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:18.790029 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:18.790356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:18.790631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:18.799915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:18.801777 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:18.811435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1355/2709] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:19.801643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:19.803384 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:19.868054 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d1b6-8b4e-406b-afc3-c975b6dd5453 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:19.871981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:19.872607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:19.872889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:19.873452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:19.875444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:19.940868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:19.942341 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:19.952513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1355/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:20.550880 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:20.560838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4735f4-2b1c-4b1b-bf03-644d047dffe7 service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:20.565054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:20.565788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:20.566056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:20.566327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:20.568407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:20.636015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:20.637791 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c773-829f-42a9-880f-3c06b6f1236a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:20.648231 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1356/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:24.627551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:24.629407 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:24.651806 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:24.705957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a6d-d9f5-4c95-b861-47a14bddacd8 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:24.711434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:24.712144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:24.712388 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:24.712653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] PATH_INFO: `/v3/users/9ae6b002250b4d72a8c8a37b29822d81` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:24.713873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae6b002250b4d72a8c8a37b29822d81)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:24.715911 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:24.777086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae6b002250b4d72a8c8a37b29822d81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:24.789936 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae6b002250b4d72a8c8a37b29822d81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:24.801220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae6b002250b4d72a8c8a37b29822d81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:24.802056 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae6b002250b4d72a8c8a37b29822d81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:24.802674 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae6b002250b4d72a8c8a37b29822d81'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:24.818320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1356/2712] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:24 2022] DELETE /identity/v3/users/9ae6b002250b4d72a8c8a37b29822d81 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:24.823131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3638-f4c5-4f56-bbec-86301af7fcfb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:24.823669 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3638-f4c5-4f56-bbec-86301af7fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:24.824192 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf3638-f4c5-4f56-bbec-86301af7fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:24.845104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-51cf3638-f4c5-4f56-bbec-86301af7fcfb None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:24.847238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-51cf3638-f4c5-4f56-bbec-86301af7fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:24.876965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:24.916161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1357/2713] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:24.926665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:24.928324 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:24.989852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80bb8-7475-4ee0-9a6b-53f86ad549dd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:24.990122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80bb8-7475-4ee0-9a6b-53f86ad549dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:24.990411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80bb8-7475-4ee0-9a6b-53f86ad549dd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:24.992446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1358/2714] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 05:29:24.999718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.000003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.000357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.009323 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafff8-c7a4-4573-bb97-62b1fd3f1dbd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:25.013150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:25.013984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.014453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.014725 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.027267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:25.027860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] MFA Rules not processed for user `bf8d5b7a906244a9997fcabc92b00e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:25.028813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dc5aa-ea14-44bb-bf21-ba18ed6620f0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:25.029242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:25.037737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1359/2715] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:29:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:25.040107 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1357/2716] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:25.055405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:25.060956 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:25.074889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f8098-d082-450d-8780-1ab5006c1e4d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:25.079059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:25.079714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.079994 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.080266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.090301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:25.091798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75f95-fb58-4601-937d-49aebb946539 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:25.103689 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1360/2717] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:25.205358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10458bd-917e-4431-a6f8-19c5bd17ecae None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.205640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10458bd-917e-4431-a6f8-19c5bd17ecae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.205914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10458bd-917e-4431-a6f8-19c5bd17ecae None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.207310 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1358/2718] 10.222.0.26 () {54 vars in 921 bytes} [Fri Sep 2 05:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 05:29:25.220340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8284-2106-44b5-b420-e4b518857424 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.220340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8284-2106-44b5-b420-e4b518857424 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.220747 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8284-2106-44b5-b420-e4b518857424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.245655 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-587d8284-2106-44b5-b420-e4b518857424 None None] MFA Rules not processed for user `5fde80d2e5cd4553b1b282284825d3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:25.246943 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-587d8284-2106-44b5-b420-e4b518857424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:25.323510 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1361/2719] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Sep 2 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:25.334457 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10458bd-917e-4431-a6f8-19c5bd17ecae None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:25.348399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10458bd-917e-4431-a6f8-19c5bd17ecae None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:25.352576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:25.353239 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.353552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.353868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.365556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d8284-2106-44b5-b420-e4b518857424 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:25.368530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-587d8284-2106-44b5-b420-e4b518857424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:25.369269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:25.370736 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:25.389053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1359/2720] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:25.390371 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d8284-2106-44b5-b420-e4b518857424 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:25.395211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:25.395871 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.396146 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.396413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] PATH_INFO: `/v3/projects/004731b3927041a7befe369552b5fbcf` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.397608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] RBAC: Authorizing `identity:delete_project(project_id=004731b3927041a7befe369552b5fbcf)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:25.399672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:25.456354 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004731b3927041a7befe369552b5fbcf', 'request_id': 'req-eff0f8bf-c2c4-4782-9f4a-78290058204b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.475382 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004731b3927041a7befe369552b5fbcf', 'request_id': 'req-eff0f8bf-c2c4-4782-9f4a-78290058204b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.482467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004731b3927041a7befe369552b5fbcf', 'request_id': 'req-eff0f8bf-c2c4-4782-9f4a-78290058204b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.495073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] The token cache is being invalidate because project 004731b3927041a7befe369552b5fbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:25.495297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.496002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.497723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1362/2721] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:25 2022] DELETE /identity/v3/projects/004731b3927041a7befe369552b5fbcf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:25.501504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:25.512474 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c7592-60d0-4cd6-9ea9-c5305ca1b503 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:25.542906 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:25.592914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:25.593861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:25.594143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:25.594630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] PATH_INFO: `/v3/users/e46a8506e6224581b3f1d0ca0fad7b4b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:25.595938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46a8506e6224581b3f1d0ca0fad7b4b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:25.598493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:25.659816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46a8506e6224581b3f1d0ca0fad7b4b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.673570 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46a8506e6224581b3f1d0ca0fad7b4b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.683833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46a8506e6224581b3f1d0ca0fad7b4b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.684949 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46a8506e6224581b3f1d0ca0fad7b4b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.686067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46a8506e6224581b3f1d0ca0fad7b4b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:25.701690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1360/2722] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:25 2022] DELETE /identity/v3/users/e46a8506e6224581b3f1d0ca0fad7b4b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:26.025646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:26.026585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:26.040826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f8bf-c2c4-4782-9f4a-78290058204b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:26.074694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:26.108701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:26.109418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:26.109698 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:26.109971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] PATH_INFO: `/v3/projects/12f6c810b6d748638827b0038f7854b7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:26.111172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f6c810b6d748638827b0038f7854b7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:26.113200 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:26.164766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f6c810b6d748638827b0038f7854b7', 'request_id': 'req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.174558 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f6c810b6d748638827b0038f7854b7', 'request_id': 'req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.184741 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f6c810b6d748638827b0038f7854b7', 'request_id': 'req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.199534 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] The token cache is being invalidate because project 12f6c810b6d748638827b0038f7854b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:26.199774 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.200611 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.205280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1363/2723] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:26 2022] DELETE /identity/v3/projects/12f6c810b6d748638827b0038f7854b7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:26.208811 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:26.210556 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:26.233974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c753-8d8b-4473-b376-d59bdbdf6e4e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:26.313752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:26.314571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:26.315011 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:26.315166 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] PATH_INFO: `/v3/users/798eb0e30c1a45d5b1b8c98f121c93a5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:26.316508 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798eb0e30c1a45d5b1b8c98f121c93a5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:26.318711 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:26.379408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798eb0e30c1a45d5b1b8c98f121c93a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.379408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:26.390908 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798eb0e30c1a45d5b1b8c98f121c93a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.397763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798eb0e30c1a45d5b1b8c98f121c93a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.398476 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798eb0e30c1a45d5b1b8c98f121c93a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.399067 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-636a5616-267e-4164-9f11-5e99b20c4dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798eb0e30c1a45d5b1b8c98f121c93a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.414004 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1361/2724] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:26 2022] DELETE /identity/v3/users/798eb0e30c1a45d5b1b8c98f121c93a5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:26.739151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:26.740681 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:26.756276 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8b4fe-5c8e-4d7b-a8f5-a589b97dc8bf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:26.817472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:26.818132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:26.818407 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:26.818676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] PATH_INFO: `/v3/projects/c09534320323498390c6935754193e6b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:26.819971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09534320323498390c6935754193e6b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:26.821893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:26.873007 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09534320323498390c6935754193e6b', 'request_id': 'req-d46a7233-1980-47ed-9597-2e9d2ab6984f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.882965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09534320323498390c6935754193e6b', 'request_id': 'req-d46a7233-1980-47ed-9597-2e9d2ab6984f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.885461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:26.890718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09534320323498390c6935754193e6b', 'request_id': 'req-d46a7233-1980-47ed-9597-2e9d2ab6984f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.905141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] The token cache is being invalidate because project c09534320323498390c6935754193e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:26.905416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.906131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d46a7233-1980-47ed-9597-2e9d2ab6984f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:26.907745 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1364/2725] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:26 2022] DELETE /identity/v3/projects/c09534320323498390c6935754193e6b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:26.913210 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:26.913708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:26.913907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:26.934586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:26.935819 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:26.998609 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1362/2726] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:27.006882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.007214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.007502 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.031315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:27.032551 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:27.042686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1365/2727] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:27.047373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.058959 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9e98-9092-4bbf-a96e-1db990400dfe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.064876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.065492 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.065774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.066033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.066677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:27.066973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.068735 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.083691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1363/2728] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:29:27.086402 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.097912 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fe67-cbfb-4870-8750-5705d7299358 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.104591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.105203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.106017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.106017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.106377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.108368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.146161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1366/2729] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:27 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:27.150672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.161127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3cac-66c3-4f03-bcc4-f1943dfb6e1e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.223696 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.224348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.224762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.225909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.226747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.228804 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.253375 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1364/2730] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:27 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:29:27.257798 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.268512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d094e-5f04-46df-a462-af299db06dc3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.273963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.274577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.274856 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.275154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.275829 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.277428 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.287715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1367/2731] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:27.292480 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.304513 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58cfcf-8e96-40e5-8c0e-c8e819fbf243 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.309423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.310023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.310303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.310577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.311303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.312944 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d01e9-dc6e-44d6-8651-82137175dd1b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.325099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1365/2732] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:29:27.329455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.340152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655823d-2cc9-44d2-89cb-8691bd5463d3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.344854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.345505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.345786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.346065 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] PATH_INFO: `/v3/projects/6a4e6fa5dd984693982f604f4224147d/users/9effb45a4ace4e378c8942e7adab4f9b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.362119 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4e6fa5dd984693982f604f4224147d, user_id=9effb45a4ace4e378c8942e7adab4f9b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.364852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.386731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1368/2733] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:27 2022] PUT /identity/v3/projects/6a4e6fa5dd984693982f604f4224147d/users/9effb45a4ace4e378c8942e7adab4f9b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:27.392462 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3dc1a-f044-4a2e-aa53-a87819e7f1e0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.392821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3dc1a-f044-4a2e-aa53-a87819e7f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.393197 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3dc1a-f044-4a2e-aa53-a87819e7f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.417053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-68e3dc1a-f044-4a2e-aa53-a87819e7f1e0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:27.418255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-68e3dc1a-f044-4a2e-aa53-a87819e7f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:27.446969 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:27.499876 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1366/2734] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:27.529181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:27.532338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:27.599859 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27e94-8cec-4e8d-a16e-bb3929d648ee admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:27.605857 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:27.606649 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:27.606923 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:27.607191 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:27.617581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:27.619008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:27.629310 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1369/2735] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:28.605348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ed05-75cf-49ad-ae0b-a30c96e89c2c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:28.605907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ed05-75cf-49ad-ae0b-a30c96e89c2c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:28.605907 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ed05-75cf-49ad-ae0b-a30c96e89c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:28.635846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-11a8ed05-75cf-49ad-ae0b-a30c96e89c2c None None] MFA Rules not processed for user `9effb45a4ace4e378c8942e7adab4f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:28.637504 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-11a8ed05-75cf-49ad-ae0b-a30c96e89c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:28.721432 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1367/2736] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:28.733046 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:28.734564 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:28.816373 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49649a0-d4b5-46a0-ae0c-fd2f41e1909a service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:28.820686 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:28.821316 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:28.821595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:28.821867 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:28.830643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:28.832109 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:28.841784 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1370/2737] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:30.230805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c521-677c-402d-b6d3-904fa769278b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:30.231377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c521-677c-402d-b6d3-904fa769278b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:30.231377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c521-677c-402d-b6d3-904fa769278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:30.252042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6030c521-677c-402d-b6d3-904fa769278b None None] MFA Rules not processed for user `9effb45a4ace4e378c8942e7adab4f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:30.253275 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6030c521-677c-402d-b6d3-904fa769278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:30.261027 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1368/2738] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:30.501211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:30.502775 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:30.515116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae30e1-54a1-4251-8dec-5a2857f212e7 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:30.519039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:30.519675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:30.519949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:30.520210 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:30.521963 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:30.531787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:30.533214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:30.541232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1371/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:33.616632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c521-677c-402d-b6d3-904fa769278b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:33.618262 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6030c521-677c-402d-b6d3-904fa769278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:33.700762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c521-677c-402d-b6d3-904fa769278b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:33.706551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:33.707171 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:33.707490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:33.707758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:33.709494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:33.721991 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:33.723626 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77b82b-3fdb-45c7-a3ec-77c8419b33dc service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:33.735152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1369/2740] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:34.435338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:34.435338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:34.449904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9de0-7c10-489d-90a0-b1417b3b46be service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:34.455326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:34.455960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:34.456234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:34.456499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] PATH_INFO: `/v3/users/af7b0de880ac4ad3bfe7fd577cad55fb` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:34.457621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7b0de880ac4ad3bfe7fd577cad55fb)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:34.459591 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:34.470459 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:34.521058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7b0de880ac4ad3bfe7fd577cad55fb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:34.529807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7b0de880ac4ad3bfe7fd577cad55fb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:34.537339 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7b0de880ac4ad3bfe7fd577cad55fb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:34.537904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7b0de880ac4ad3bfe7fd577cad55fb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:34.551527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7b0de880ac4ad3bfe7fd577cad55fb'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:34.558370 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1372/2741] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:34 2022] DELETE /identity/v3/users/af7b0de880ac4ad3bfe7fd577cad55fb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:34.563216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:34.563587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:34.563930 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:34.584648 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:34.586034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:34.627444 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:34.655369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1370/2742] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:34.665801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:34.667301 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:34.730989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40d51-3982-4266-97b5-1b10d2935645 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:34.735557 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:34.736167 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:34.736438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:34.736739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:34.748124 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:34.749562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:34.759188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1373/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:35.035849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:35.037355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:35.049369 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c66c0-fe41-4b07-91b7-ae0c6e15e83f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:35.055143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:35.056222 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:35.056687 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:35.057149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] PATH_INFO: `/v3/projects/df3f065176f6428caca6dfbf6d6609f0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:35.058357 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3f065176f6428caca6dfbf6d6609f0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:35.060381 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:35.110346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3f065176f6428caca6dfbf6d6609f0', 'request_id': 'req-ff7b1320-24e4-404f-99c4-63e19467193d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:35.116922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3f065176f6428caca6dfbf6d6609f0', 'request_id': 'req-ff7b1320-24e4-404f-99c4-63e19467193d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:35.122752 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3f065176f6428caca6dfbf6d6609f0', 'request_id': 'req-ff7b1320-24e4-404f-99c4-63e19467193d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:35.137702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] The token cache is being invalidate because project df3f065176f6428caca6dfbf6d6609f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:35.137999 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:35.138630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:35.140205 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1371/2744] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:35 2022] DELETE /identity/v3/projects/df3f065176f6428caca6dfbf6d6609f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:44.754888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:45.134545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:47.550302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:47.551766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:47.563991 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f448-3fbc-48a6-8684-0301fcadf5cb service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:47.616916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:47.617527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:47.617801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:47.618043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:47.619980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:47.688652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:47.690142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:47.700779 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1374/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:51.113374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.115070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:51.185796 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.187404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:51.199095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1320-24e4-404f-99c4-63e19467193d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.200653 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a92a3-ed80-4217-8631-ca7c6aade992 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.208706 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.209363 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.210086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.210414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.211517 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.212291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:51.212683 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.213174 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.213644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] PATH_INFO: `/v3/users/ad165b2ffe474917b042bfa5d356366b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.214990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad165b2ffe474917b042bfa5d356366b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.217201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.228173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.229762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.240362 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1372/2746] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:51.274273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad165b2ffe474917b042bfa5d356366b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.283858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad165b2ffe474917b042bfa5d356366b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.291266 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad165b2ffe474917b042bfa5d356366b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.291888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad165b2ffe474917b042bfa5d356366b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.303542 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-16b732d3-f549-491e-a34b-afc0ac8dc133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad165b2ffe474917b042bfa5d356366b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.309406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1375/2747] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:29:51 2022] DELETE /identity/v3/users/ad165b2ffe474917b042bfa5d356366b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:51.493307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.505881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baf336-9093-4ebc-a877-735ded6ad409 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.564840 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.565482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.565758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.566030 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] PATH_INFO: `/v3/projects/26591bb546ce494099c8f896afd0833b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.567117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=26591bb546ce494099c8f896afd0833b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.569063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.619098 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26591bb546ce494099c8f896afd0833b', 'request_id': 'req-ea0668e4-c90d-45df-a718-ecf1b46280dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.625629 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26591bb546ce494099c8f896afd0833b', 'request_id': 'req-ea0668e4-c90d-45df-a718-ecf1b46280dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.631764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26591bb546ce494099c8f896afd0833b', 'request_id': 'req-ea0668e4-c90d-45df-a718-ecf1b46280dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.647689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] The token cache is being invalidate because project 26591bb546ce494099c8f896afd0833b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:29:51.648019 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.648933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ea0668e4-c90d-45df-a718-ecf1b46280dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:29:51.651048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1373/2748] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:29:51 2022] DELETE /identity/v3/projects/26591bb546ce494099c8f896afd0833b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:29:51.656391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.656678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.656957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.678168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:51.679450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:51.696946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:51.741552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1376/2749] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:51.751116 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.751418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.751684 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.775366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:51.776621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:51.785526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1374/2750] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:29:51.790645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.801273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6b6d-fa74-4ce1-8b1b-507b16026c7f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.807161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.807807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.808089 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.808365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.809013 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:29:51.809313 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.811033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.823102 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1377/2751] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:29:51.827723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.837557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce1d32-41b0-456a-93c3-22235209ad06 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.844065 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.844668 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.844945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.845203 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.845836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.847801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.859849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:51.880126 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1375/2752] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:29:51 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:51.884445 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.895175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3bf0c-9640-474b-b3b9-516db743da41 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:51.954737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:51.955386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:51.955661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:51.955925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:51.956563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:51.958499 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:51.981457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1378/2753] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:29:51 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:29:51.985772 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:51.996676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925d31-78b5-4fa6-a891-e6152781ec9b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:52.002045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:52.002636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:52.002910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:52.003175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:52.003853 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:52.005454 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:52.015547 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1376/2754] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:52.019554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:52.030107 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b1bd-4297-4437-9639-b10526c9599b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:52.034922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:52.035550 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:52.035824 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:52.036094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:52.036728 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:52.038343 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81efc82-eae9-4db6-b0e0-2406a0730129 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:52.053153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1379/2755] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:29:52.057595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:52.068031 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce159201-f962-4105-841d-5aea262123c2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:52.073155 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:52.073827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:52.074100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:52.074365 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] PATH_INFO: `/v3/projects/82509c97a31e41d2a7d1bdbd21ae8540/users/d6896a9031c04da59460ef8277335cd0/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:52.092631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82509c97a31e41d2a7d1bdbd21ae8540, user_id=d6896a9031c04da59460ef8277335cd0, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:52.095433 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:52.109111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1377/2756] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:29:52 2022] PUT /identity/v3/projects/82509c97a31e41d2a7d1bdbd21ae8540/users/d6896a9031c04da59460ef8277335cd0/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:29:52.114724 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e64cd6-62fc-40c8-b979-ca29ac899116 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:52.115125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e64cd6-62fc-40c8-b979-ca29ac899116 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:52.115430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e64cd6-62fc-40c8-b979-ca29ac899116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:52.139818 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-04e64cd6-62fc-40c8-b979-ca29ac899116 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:52.140982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-04e64cd6-62fc-40c8-b979-ca29ac899116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:52.206570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1380/2757] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:52.216675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:52.218573 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:52.281781 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259c113-ff3e-43d4-9e64-47236a257705 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:52.286438 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:52.287104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:52.287396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:52.287658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:52.297987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:52.299527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:52.309705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1378/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:55.705267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5a75-101e-4d0a-83d4-f946a45cc03e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:55.706484 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5a75-101e-4d0a-83d4-f946a45cc03e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:55.707465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5a75-101e-4d0a-83d4-f946a45cc03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:55.732067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e36f5a75-101e-4d0a-83d4-f946a45cc03e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:55.736565 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e36f5a75-101e-4d0a-83d4-f946a45cc03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:55.746588 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1381/2759] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:55.766483 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:55.768954 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:55.877245 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b1b92-5796-4209-b05e-f853b26f1784 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:55.888719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:55.889401 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:55.889738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:55.890052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:55.899863 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:55.901490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:55.912784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1379/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:56.595910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23533d-c300-4b13-8830-3a0ba2f3a6bb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:56.596193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23533d-c300-4b13-8830-3a0ba2f3a6bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:56.596642 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23533d-c300-4b13-8830-3a0ba2f3a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:56.631579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-eb23533d-c300-4b13-8830-3a0ba2f3a6bb None None] MFA Rules not processed for user `d6896a9031c04da59460ef8277335cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:56.632965 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eb23533d-c300-4b13-8830-3a0ba2f3a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:56.644414 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:29:56.712252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1382/2761] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:56.727417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:56.728927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:56.745037 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00d67-d0eb-47fb-8e0d-7a8521e956c3 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:56.750957 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:56.751617 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:56.751889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:56.752154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:56.761012 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:56.762643 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3a12-cc01-4aed-9166-a01b297089c2 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:56.772653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1380/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:29:58.112937 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:58.113475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:58.113652 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:58.137022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] MFA Rules not processed for user `d6896a9031c04da59460ef8277335cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:58.138256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:58.146070 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1383/2763] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:58.790979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef10c-0f12-4345-a01d-7a2cf834353b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:58.791501 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef10c-0f12-4345-a01d-7a2cf834353b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:58.791945 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef10c-0f12-4345-a01d-7a2cf834353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:58.816848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cc3ef10c-0f12-4345-a01d-7a2cf834353b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:29:58.818436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cc3ef10c-0f12-4345-a01d-7a2cf834353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:29:58.828345 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1381/2764] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:29:58.842968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:29:58.856500 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700ca7-c71d-47b9-9829-e871ade0b53e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:29:58.863461 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:29:58.864233 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:29:58.864604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:29:58.864971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:29:58.887570 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:29:58.890523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:29:58.915731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1384/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:02.065277 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec594f-fb49-4777-a2cb-a1776d67875b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:02.065836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec594f-fb49-4777-a2cb-a1776d67875b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:02.065942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec594f-fb49-4777-a2cb-a1776d67875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:02.086681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f1ec594f-fb49-4777-a2cb-a1776d67875b None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:02.087977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f1ec594f-fb49-4777-a2cb-a1776d67875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:02.097435 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1382/2766] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:30:02.112099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:02.124592 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3fb50-7ebc-4853-9366-b893299611bb service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:02.131418 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:02.132034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:02.132308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:02.132576 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:02.142353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:02.144096 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:02.155230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1385/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:05.197537 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396a06-a100-4aef-9940-8b589c316509 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:05.198253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396a06-a100-4aef-9940-8b589c316509 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:05.198253 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396a06-a100-4aef-9940-8b589c316509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:05.219143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-95396a06-a100-4aef-9940-8b589c316509 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:05.220399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-95396a06-a100-4aef-9940-8b589c316509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:05.229602 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1383/2768] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:05.245061 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:05.262471 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edb4a4-c336-4ef4-b800-4d56a2865679 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:05.270009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:05.270617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:05.270897 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:05.271155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:05.280525 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:05.282136 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:05.292892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1386/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:08.403418 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8faca-4910-4f62-bb3e-e47a8591b921 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:08.404039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8faca-4910-4f62-bb3e-e47a8591b921 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:08.404039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8faca-4910-4f62-bb3e-e47a8591b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:08.424409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ffa8faca-4910-4f62-bb3e-e47a8591b921 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:08.425574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ffa8faca-4910-4f62-bb3e-e47a8591b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:08.433927 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1384/2770] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:08.449456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:08.461321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f6226-fc76-43f5-9e70-7419db2a79f8 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:08.473889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:08.474478 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:08.474945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:08.475731 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:08.485346 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:08.486951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:08.499778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1387/2771] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:11.574348 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:11.574864 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:11.574977 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:11.591947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:11.604044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:11.605320 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:11.613621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1385/2772] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:11.628506 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:11.640388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d053b04-29b5-4bb5-b876-79e03f4c980e service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:11.647381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:11.647983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:11.648257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:11.648527 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:11.657079 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:11.659054 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df463e-0f8b-4080-8f92-f104963c2696 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:11.668521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1388/2773] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:12.963545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:12.976622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1e97-4bf6-48f5-b697-ac7e4c03de8d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:12.982633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:12.983360 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:12.983747 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:12.983928 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:12.986043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:13.000058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:13.001831 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:13.013053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1386/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:21.664598 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=55 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:23.008639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:25.769855 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ec1b-72d5-41c9-84c6-f7712eb01120 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:25.770359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ec1b-72d5-41c9-84c6-f7712eb01120 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:25.770359 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ec1b-72d5-41c9-84c6-f7712eb01120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:25.789719 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-afd8ec1b-72d5-41c9-84c6-f7712eb01120 None None] MFA Rules not processed for user `9effb45a4ace4e378c8942e7adab4f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:25.790926 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-afd8ec1b-72d5-41c9-84c6-f7712eb01120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:25.859364 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1389/2775] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:26.113983 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:26.115786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:26.128405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5e61-7f45-48a5-87f9-4951f693ef56 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:26.132671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:26.133280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:26.133531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:26.133796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:26.135569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:26.145013 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:26.146429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:26.154209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1387/2776] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:35.851073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:36.151089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:30:39.914571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd78f-18f5-4775-8938-e70d3e1bf410 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:39.915163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd78f-18f5-4775-8938-e70d3e1bf410 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:39.915163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd78f-18f5-4775-8938-e70d3e1bf410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:39.936214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-317fd78f-18f5-4775-8938-e70d3e1bf410 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:39.937419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-317fd78f-18f5-4775-8938-e70d3e1bf410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:39.949282 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1390/2777] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:39.965228 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:39.980408 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3ae13-267c-4079-b670-6b85d1ebb4a5 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:39.986550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:39.987151 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:39.987452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:39.987717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:39.996477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:39.998060 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:40.007662 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1388/2778] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:43.194488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975928-3c10-49e4-82ff-0212b92515d8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:43.195038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975928-3c10-49e4-82ff-0212b92515d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:43.195038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975928-3c10-49e4-82ff-0212b92515d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:43.218042 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1975928-3c10-49e4-82ff-0212b92515d8 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:43.219284 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1975928-3c10-49e4-82ff-0212b92515d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:43.228794 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1391/2779] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:43.243423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:43.255546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005fe-0b11-41ea-b294-5f7f0c100a8f service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:43.262681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:43.263326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:43.263600 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:43.263861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:43.272685 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:43.274259 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:43.283894 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1389/2780] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:46.265311 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13832-7b92-43ae-8080-b6ffafeff343 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:46.265863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13832-7b92-43ae-8080-b6ffafeff343 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:46.265863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13832-7b92-43ae-8080-b6ffafeff343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:46.290536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8aa13832-7b92-43ae-8080-b6ffafeff343 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:46.292395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8aa13832-7b92-43ae-8080-b6ffafeff343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:46.304807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1392/2781] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:46.321495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:46.332878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693622-8964-47c1-a1f6-3b3f3f1cdd7f service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:46.340909 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:46.341562 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:46.341834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:46.342102 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:46.352482 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:46.354266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:46.365541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1390/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:49.451545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ebb7e-2d5d-45b8-b047-4d55c22587a9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:49.452097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ebb7e-2d5d-45b8-b047-4d55c22587a9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:49.452097 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ebb7e-2d5d-45b8-b047-4d55c22587a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:49.477203 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a78ebb7e-2d5d-45b8-b047-4d55c22587a9 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:49.478421 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a78ebb7e-2d5d-45b8-b047-4d55c22587a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:49.490163 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1393/2783] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:49.506842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:49.518980 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6c122-28ed-4090-af1a-669ef03ff3bc service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:49.525083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:49.525693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:49.525972 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:49.526244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:49.534884 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:49.536715 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:49.547154 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1391/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:30:52.653293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d777d-786f-402e-a39a-ddaf33e9a235 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:52.653788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d777d-786f-402e-a39a-ddaf33e9a235 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:52.653902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d777d-786f-402e-a39a-ddaf33e9a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:52.681249 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0c7d777d-786f-402e-a39a-ddaf33e9a235 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:52.682569 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0c7d777d-786f-402e-a39a-ddaf33e9a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:52.692590 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1394/2785] 10.222.0.36 () {58 vars in 1016 bytes} [Fri Sep 2 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:30:52.711583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:30:52.725486 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86af04c-9a3b-4356-ad12-e16ebe578ac6 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:30:52.733264 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:30:52.734069 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:52.734353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:52.734625 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:52.745134 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:30:52.746923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:30:52.757799 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1392/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:30:56.181485 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:30:56.182012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:30:56.182012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:30:56.202236 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] MFA Rules not processed for user `d6896a9031c04da59460ef8277335cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:30:56.203470 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:30:56.211788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1395/2787] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:31:02.753083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=30 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:04.950660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:04.951339 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:04.965694 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ca321-d100-400b-b76c-c648ef0a4be7 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:04.970575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:04.971234 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:04.971520 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:04.971768 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] PATH_INFO: `/v3/users/c11884b7e24b43c28150ff72992fd3e9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:04.973497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11884b7e24b43c28150ff72992fd3e9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:04.975588 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:05.030652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11884b7e24b43c28150ff72992fd3e9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.048816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11884b7e24b43c28150ff72992fd3e9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.057333 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11884b7e24b43c28150ff72992fd3e9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.058503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11884b7e24b43c28150ff72992fd3e9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.059465 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11884b7e24b43c28150ff72992fd3e9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.074802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1393/2788] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:31:04 2022] DELETE /identity/v3/users/c11884b7e24b43c28150ff72992fd3e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:31:05.260291 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:05.273918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf52fe-1a50-4b19-84b7-bc6ad03fec99 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:05.334446 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:05.335088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:05.335392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:05.335665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] PATH_INFO: `/v3/projects/7e2f038164884e79892cf80e2c00f8d7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:05.336842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2f038164884e79892cf80e2c00f8d7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:05.338765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:05.388736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2f038164884e79892cf80e2c00f8d7', 'request_id': 'req-418d4991-a36e-4fca-a91a-12b9a0322b31'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.397852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2f038164884e79892cf80e2c00f8d7', 'request_id': 'req-418d4991-a36e-4fca-a91a-12b9a0322b31'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.404342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2f038164884e79892cf80e2c00f8d7', 'request_id': 'req-418d4991-a36e-4fca-a91a-12b9a0322b31'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.415959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] The token cache is being invalidate because project 7e2f038164884e79892cf80e2c00f8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:31:05.416275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.416918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.418443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1396/2789] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:31:05 2022] DELETE /identity/v3/projects/7e2f038164884e79892cf80e2c00f8d7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:31:05.422585 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:05.424064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:05.437712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065f5f-493d-4bb9-bcbe-d8c3319c70f3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:05.501642 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:05.502280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:05.502555 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:05.502821 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] PATH_INFO: `/v3/users/0b347d7a769a465fabdc612f90aa5b56` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:05.503984 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b347d7a769a465fabdc612f90aa5b56)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:05.506055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:05.556921 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b347d7a769a465fabdc612f90aa5b56'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.569150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b347d7a769a465fabdc612f90aa5b56'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.576064 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b347d7a769a465fabdc612f90aa5b56'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.576739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b347d7a769a465fabdc612f90aa5b56'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.577355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b347d7a769a465fabdc612f90aa5b56'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.579039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:05.592630 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1394/2790] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:31:05 2022] DELETE /identity/v3/users/0b347d7a769a465fabdc612f90aa5b56 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:31:05.774122 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:05.775893 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:05.791942 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4991-a36e-4fca-a91a-12b9a0322b31 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:05.845985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:05.857737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:05.858555 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:05.859035 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:05.859361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] PATH_INFO: `/v3/projects/9da8a99072004e94b1471c992d820e8d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:05.860549 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da8a99072004e94b1471c992d820e8d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:05.862786 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:05.920327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da8a99072004e94b1471c992d820e8d', 'request_id': 'req-3c770e56-7d78-41c2-8699-6cea2fdccf1f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.929608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da8a99072004e94b1471c992d820e8d', 'request_id': 'req-3c770e56-7d78-41c2-8699-6cea2fdccf1f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.936223 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da8a99072004e94b1471c992d820e8d', 'request_id': 'req-3c770e56-7d78-41c2-8699-6cea2fdccf1f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.949201 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] The token cache is being invalidate because project 9da8a99072004e94b1471c992d820e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:31:05.949518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.950297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:05.971234 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1397/2791] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:31:05 2022] DELETE /identity/v3/projects/9da8a99072004e94b1471c992d820e8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:31:15.592120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:15.946523 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:21.184244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:21.185997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:21.239108 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:21.241422 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:21.345734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222f75-6ce9-41f2-b76b-0e736f9db417 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:21.373951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770e56-7d78-41c2-8699-6cea2fdccf1f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:21.379125 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:21.379801 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:21.380071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:21.380327 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] PATH_INFO: `/v3/users/9effb45a4ace4e378c8942e7adab4f9b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:21.381469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9effb45a4ace4e378c8942e7adab4f9b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:21.383419 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:21.407878 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:21.408571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:21.408849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:21.409148 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:21.411091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:21.423489 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:21.425452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:21.432596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9effb45a4ace4e378c8942e7adab4f9b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.436542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1395/2792] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:31:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:31:21.441847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9effb45a4ace4e378c8942e7adab4f9b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.449767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9effb45a4ace4e378c8942e7adab4f9b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.450483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9effb45a4ace4e378c8942e7adab4f9b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.463833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9effb45a4ace4e378c8942e7adab4f9b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.470815 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1398/2793] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:31:21 2022] DELETE /identity/v3/users/9effb45a4ace4e378c8942e7adab4f9b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:31:21.672677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:21.684130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa186d-9793-4649-ad07-c8c6394e786b service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:21.707366 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:21.745451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:21.746085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:21.746374 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:21.746635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] PATH_INFO: `/v3/projects/6a4e6fa5dd984693982f604f4224147d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:21.747794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4e6fa5dd984693982f604f4224147d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:21.749716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:21.798380 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4e6fa5dd984693982f604f4224147d', 'request_id': 'req-5780de67-46c6-4ded-8f10-fafeb4202682'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.804723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4e6fa5dd984693982f604f4224147d', 'request_id': 'req-5780de67-46c6-4ded-8f10-fafeb4202682'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.810558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4e6fa5dd984693982f604f4224147d', 'request_id': 'req-5780de67-46c6-4ded-8f10-fafeb4202682'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.824288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] The token cache is being invalidate because project 6a4e6fa5dd984693982f604f4224147d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:31:21.824502 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.825100 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5780de67-46c6-4ded-8f10-fafeb4202682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:31:21.826551 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1396/2794] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:31:21 2022] DELETE /identity/v3/projects/6a4e6fa5dd984693982f604f4224147d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:31:30.609424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:31:30.610967 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:30.643748 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:30.683245 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc098-634d-4581-bed5-9732849e3096 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:31:30.753625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:31:30.754353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:30.754505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:30.754767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:30.756721 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:30.768171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:31:30.769900 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:31:30.779990 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1399/2795] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:31:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:31:31.821353 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:40.775961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=46 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:31:59.879086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:31:59.879635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:31:59.879635 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:31:59.899779 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] MFA Rules not processed for user `d6896a9031c04da59460ef8277335cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:31:59.900990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:31:59.960193 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1397/2796] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:31:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:32:09.952667 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:16.395299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:33:16.397009 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:33:16.482140 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757d5c-b904-496d-8980-50efe28ca8a9 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:33:16.486252 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:33:16.486858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:33:16.487138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:33:16.487444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:33:16.489753 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:33:16.590761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:33:16.592296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa84e2-cc94-49b3-8f08-c5c6de9b17a1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:33:16.613827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1400/2797] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:33:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:33:19.217481 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:33:19.219066 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:33:19.304718 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c5bdb-5d9f-4c11-84c6-2da6afd83a5b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:33:19.308990 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:33:19.309590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:33:19.309861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:33:19.310133 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:33:19.312000 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:33:19.326391 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:33:19.327868 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:33:19.339312 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1398/2798] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:33:23.680995 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:33:23.681535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:33:23.682002 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:33:23.706112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] MFA Rules not processed for user `d6896a9031c04da59460ef8277335cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:33:23.707379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:33:23.715983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1401/2799] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:33:29.334329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=35 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:33:33.698984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=78 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:23.276569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:23.278072 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:23.343329 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d5b3-ba6c-462a-93d9-7123c22377a6 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:23.347897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:23.348531 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:23.348833 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:23.349114 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] PATH_INFO: `/v3/users/d6896a9031c04da59460ef8277335cd0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:23.350359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6896a9031c04da59460ef8277335cd0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:23.352352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:23.402710 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6896a9031c04da59460ef8277335cd0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.414705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6896a9031c04da59460ef8277335cd0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.421932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6896a9031c04da59460ef8277335cd0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.422589 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6896a9031c04da59460ef8277335cd0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.423241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-a1c8febd-9a1c-4d3e-8663-e237e63cdd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6896a9031c04da59460ef8277335cd0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.438420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1399/2800] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:23 2022] DELETE /identity/v3/users/d6896a9031c04da59460ef8277335cd0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:23.625150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:23.637165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4fd2b-ff0e-425c-b76b-acfda9f41e8a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:23.695974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:23.696530 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:23.696808 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:23.697073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] PATH_INFO: `/v3/projects/82509c97a31e41d2a7d1bdbd21ae8540` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:23.698211 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82509c97a31e41d2a7d1bdbd21ae8540)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:23.700148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:23.749426 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82509c97a31e41d2a7d1bdbd21ae8540', 'request_id': 'req-ab751666-621a-4353-9bf5-1474cdd044e5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.759404 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82509c97a31e41d2a7d1bdbd21ae8540', 'request_id': 'req-ab751666-621a-4353-9bf5-1474cdd044e5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.765302 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82509c97a31e41d2a7d1bdbd21ae8540', 'request_id': 'req-ab751666-621a-4353-9bf5-1474cdd044e5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.777118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] The token cache is being invalidate because project 82509c97a31e41d2a7d1bdbd21ae8540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:23.777413 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.778175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ab751666-621a-4353-9bf5-1474cdd044e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:23.779827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1402/2801] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:23 2022] DELETE /identity/v3/projects/82509c97a31e41d2a7d1bdbd21ae8540 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:23.785113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:23.785405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:23.785679 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:23.850656 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:23.851981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:23.899835 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:23.921729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1400/2802] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:23.932306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:23.932595 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:23.932870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:23.953891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:23.955038 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:23.964092 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1403/2803] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:23.968605 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:23.978937 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44370290-1a7d-456b-abff-157100ed23f1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:23.984448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:23.985051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:23.985332 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:23.985606 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:23.986272 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:34:23.986577 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:23.988314 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.000499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1401/2804] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:34:24.005072 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.014795 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05169998-058f-42f8-b52b-c481ca9c2392 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.020289 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.020983 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.021262 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.021553 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.022177 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.024151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.066905 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1404/2805] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:24 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:24.073083 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.087824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102856e-b0cd-4614-9892-2a01fac69fa2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.151235 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.151866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.152135 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.152398 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.153028 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.154993 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.179109 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1402/2806] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:24 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:24.183579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.194142 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a37032-3710-4266-b1c3-064d400ea7ba admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.198811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.199436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.199714 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.199977 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.200631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.202238 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.212151 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1405/2807] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:24.217552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.228244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f18-0429-4898-829e-3383d5db4cff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.233149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.233748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.234020 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.234284 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.235022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.236666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559e728-cda9-45ad-85bb-8ec6a00e5ce5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.247303 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1403/2808] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:24.251673 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.264822 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9c43b-53ed-452b-87d3-a42162e5bb4a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.270665 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.271858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.272168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.272429 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] PATH_INFO: `/v3/projects/4791de34e3fc483db902a9c64a3fb5d5/users/08902b7a1d3a418ba6ae6d7d90c70a0c/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.289179 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4791de34e3fc483db902a9c64a3fb5d5, user_id=08902b7a1d3a418ba6ae6d7d90c70a0c, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.291947 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.307617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1406/2809] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:24 2022] PUT /identity/v3/projects/4791de34e3fc483db902a9c64a3fb5d5/users/08902b7a1d3a418ba6ae6d7d90c70a0c/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:24.320495 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.320948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.321055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.351583 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] MFA Rules not processed for user `08902b7a1d3a418ba6ae6d7d90c70a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:24.353063 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:24.424055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1404/2810] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:24.437716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:24.439723 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:24.466317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:24.522696 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c1fb-b85d-4af4-8090-5e7bd846c77e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:24.528778 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fde80d2e5cd4553b1b282284825d3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:24.529384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:24.529659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:24.529921 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:24.538604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:24.540214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256936-0a1d-4674-a7e5-7522cfa8a895 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:24.550050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1407/2811] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:27.294497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:27.339317 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:27.358780 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224cc1-f2e8-4754-b9f1-8da41442e1c2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:27.363599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:27.364582 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:27.364860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:27.365127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] PATH_INFO: `/v3/users/08902b7a1d3a418ba6ae6d7d90c70a0c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:27.366517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08902b7a1d3a418ba6ae6d7d90c70a0c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:27.368512 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:27.417094 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08902b7a1d3a418ba6ae6d7d90c70a0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:27.429421 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08902b7a1d3a418ba6ae6d7d90c70a0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:27.436355 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08902b7a1d3a418ba6ae6d7d90c70a0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:27.437061 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08902b7a1d3a418ba6ae6d7d90c70a0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:27.437688 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08902b7a1d3a418ba6ae6d7d90c70a0c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:27.462373 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1405/2812] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:27 2022] DELETE /identity/v3/users/08902b7a1d3a418ba6ae6d7d90c70a0c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:27.469925 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:27.470927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:27.470927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:27.494432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:27.495749 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:27.560048 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1408/2813] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:27.572621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:27.575326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:27.650184 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf7dd-dedb-498a-be4e-b17bf86360e1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:27.654734 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:27.655386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:27.655666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:27.655929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:27.666263 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:27.667796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4121ce-5e76-4baf-9436-28a78963298f service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:27.678221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1406/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:27.953710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:27.955267 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:27.967854 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1696c-c8a1-4e86-af10-c94b1e4e4006 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:27.972830 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:27.973257 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:27.973536 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:27.973806 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] PATH_INFO: `/v3/projects/4791de34e3fc483db902a9c64a3fb5d5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:27.974992 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4791de34e3fc483db902a9c64a3fb5d5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:27.977357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.026455 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4791de34e3fc483db902a9c64a3fb5d5', 'request_id': 'req-9d302f8d-d9e1-49aa-8593-a32545f680aa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:28.035166 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4791de34e3fc483db902a9c64a3fb5d5', 'request_id': 'req-9d302f8d-d9e1-49aa-8593-a32545f680aa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:28.041161 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4791de34e3fc483db902a9c64a3fb5d5', 'request_id': 'req-9d302f8d-d9e1-49aa-8593-a32545f680aa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:28.052162 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] The token cache is being invalidate because project 4791de34e3fc483db902a9c64a3fb5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:28.052452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:28.053147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9d302f8d-d9e1-49aa-8593-a32545f680aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:28.054722 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1409/2815] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:27 2022] DELETE /identity/v3/projects/4791de34e3fc483db902a9c64a3fb5d5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:28.060141 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.060429 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.060702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.083576 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:28.085211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:28.152469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1407/2816] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:34:28.160654 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.160939 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.161216 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.182462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:28.183709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:28.192239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1410/2817] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:28.196690 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.206678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47916-a13a-4e7a-a019-7d258449c84a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.211739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.212349 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.212608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.212985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.213666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:34:28.213958 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.215590 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.217088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:28.229505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1408/2818] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:34:28.233902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.244152 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bcac-6132-43be-8c45-0a373f04b3a7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.249182 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.249787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.250064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.250335 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.250971 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.252961 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.275879 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:28.283985 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1411/2819] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:28.288608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.299008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c21-c53b-4445-9547-843083032592 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.357910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.358517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.358791 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.359058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.359716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.361652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.384174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1409/2820] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:34:28.388424 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.399361 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516d75-857b-4839-b5d3-d254b6b13362 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.405308 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.405922 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.406204 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.406472 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.407150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.408797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.419377 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1412/2821] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:28.423307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.434162 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb08e-d055-4dd9-b2ea-87be9165c536 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.439209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.439849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.440121 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.440389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.441023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.442624 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f7b8-682b-43b7-bb41-31450963cc4b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.453636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1410/2822] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:28.459435 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.470535 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f216a-4287-4855-b905-6a844ec249ae admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.476153 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.476807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.477085 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.477356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] PATH_INFO: `/v3/projects/6ff4aa11281442b7ad0f9594bee7648e/users/4877a0d8f7d1463f8ff7ae1c3933da1b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.496482 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff4aa11281442b7ad0f9594bee7648e, user_id=4877a0d8f7d1463f8ff7ae1c3933da1b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.499718 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.514349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1413/2823] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:28 2022] PUT /identity/v3/projects/6ff4aa11281442b7ad0f9594bee7648e/users/4877a0d8f7d1463f8ff7ae1c3933da1b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:28.525995 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.526274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.526539 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.554966 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] MFA Rules not processed for user `4877a0d8f7d1463f8ff7ae1c3933da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:28.556255 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:28.632657 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1411/2824] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:28.637395 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.701158 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881368ad-dceb-4ee3-b4f3-3168344750ad admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.706280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.706877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.707149 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.707450 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.708067 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.709954 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.744661 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1414/2825] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:28.750788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.768021 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c662e32-4d59-4c11-a3f4-964ecf7f5bdb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.830335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.830948 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.831246 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.831517 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.832132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.834132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.843395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:28.857237 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1412/2826] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:28 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:28.861443 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.872787 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ebd2-ca29-45b6-9861-c4ea4d53233f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.878232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.878836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.879114 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.879415 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.880056 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.881894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.892812 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1415/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:28.897257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.908202 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216ed4-e605-4f0d-bcbb-fb0b170005d7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:28.914199 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:28.914861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:28.915132 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:28.915428 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] PATH_INFO: `/v3/projects/913f241639a046dab73be5c02369c57e/users/dc4cbd613bc7433b92f10bc098604379/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:28.931403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=913f241639a046dab73be5c02369c57e, user_id=dc4cbd613bc7433b92f10bc098604379, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:28.934073 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:28.949266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1413/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:28 2022] PUT /identity/v3/projects/913f241639a046dab73be5c02369c57e/users/dc4cbd613bc7433b92f10bc098604379/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:28.953367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:28.964020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d732a-85e4-40e9-bb39-6df4492f1969 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:29.028870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:29.029481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:29.029762 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:29.030034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:29.030674 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:29.032298 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07942-6087-4576-8e53-1b1765e582fe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:29.042489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1416/2829] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:29.046778 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:29.057288 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9f72-d406-42ad-805c-1c2ec9d1bdea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:29.062175 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:29.062816 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:29.063092 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:29.063383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] PATH_INFO: `/v3/projects/913f241639a046dab73be5c02369c57e/users/dc4cbd613bc7433b92f10bc098604379/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:29.065280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=913f241639a046dab73be5c02369c57e, user_id=dc4cbd613bc7433b92f10bc098604379, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:29.067975 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:29.078441 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1414/2830] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:29 2022] PUT /identity/v3/projects/913f241639a046dab73be5c02369c57e/users/dc4cbd613bc7433b92f10bc098604379/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:29.089093 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:29.089378 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:29.089650 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:29.121312 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] MFA Rules not processed for user `dc4cbd613bc7433b92f10bc098604379`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:29.122578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:29.147137 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:29.200110 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1417/2831] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:29.211703 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:29.213686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:29.283568 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fac7e-8f82-49ed-8662-02e2072c3d6b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:29.288695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:29.289623 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:29.290045 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:29.290386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:29.355014 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:29.356515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:29.366396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1415/2832] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:31.985993 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:31.996918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea2781-07a7-4a11-9b01-5dc707c69f94 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:32.001456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:32.002059 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:32.002336 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:32.002604 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:32.012148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:32.013572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959e20-ffc6-4b5b-b1e7-769bb2c0f69c service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:32.022941 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1418/2833] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:39.361805 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=4,keystone:SELECT=65 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:42.019091 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:44.792266 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:44.858873 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d4f0-5272-4b30-ad03-8be8a460a55d service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:44.864932 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:44.865563 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:44.865836 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:44.866112 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] PATH_INFO: `/v3/users/4877a0d8f7d1463f8ff7ae1c3933da1b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:44.867412 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4877a0d8f7d1463f8ff7ae1c3933da1b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:44.869352 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:44.920085 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4877a0d8f7d1463f8ff7ae1c3933da1b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:44.933243 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4877a0d8f7d1463f8ff7ae1c3933da1b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:44.940807 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4877a0d8f7d1463f8ff7ae1c3933da1b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:44.941571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4877a0d8f7d1463f8ff7ae1c3933da1b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:44.942294 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4877a0d8f7d1463f8ff7ae1c3933da1b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:44.958545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1416/2834] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:44 2022] DELETE /identity/v3/users/4877a0d8f7d1463f8ff7ae1c3933da1b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:44.963296 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:44.963817 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:44.963949 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:44.986401 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:44.987621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:45.050725 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1419/2835] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:45.062386 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:45.063955 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:45.131530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3843e-0675-4687-8a2d-e60930c2c806 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:45.135847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:45.136461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:45.136730 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:45.136997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:45.146794 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:45.148257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:45.157763 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1417/2836] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:45.452444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:45.454090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:45.473813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc725a7-9b04-47fa-995c-e5e9a17f33cf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:45.478658 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:45.479351 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:45.479636 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:45.479953 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] PATH_INFO: `/v3/projects/6ff4aa11281442b7ad0f9594bee7648e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:45.481713 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff4aa11281442b7ad0f9594bee7648e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:45.483894 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:45.538430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff4aa11281442b7ad0f9594bee7648e', 'request_id': 'req-1642ca10-5224-4902-b28b-7176c34566fa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.548451 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff4aa11281442b7ad0f9594bee7648e', 'request_id': 'req-1642ca10-5224-4902-b28b-7176c34566fa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.557334 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff4aa11281442b7ad0f9594bee7648e', 'request_id': 'req-1642ca10-5224-4902-b28b-7176c34566fa'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.569929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] The token cache is being invalidate because project 6ff4aa11281442b7ad0f9594bee7648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:45.570217 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.570858 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.572392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1420/2837] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:45 2022] DELETE /identity/v3/projects/6ff4aa11281442b7ad0f9594bee7648e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:45.576516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:45.586857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec923a-630c-4bcc-add2-030ff6043900 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:45.605593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:45.647584 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:45.648212 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:45.648490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:45.648757 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] PATH_INFO: `/v3/users/dc4cbd613bc7433b92f10bc098604379` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:45.649883 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4cbd613bc7433b92f10bc098604379)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:45.651867 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:45.703036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4cbd613bc7433b92f10bc098604379'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.714790 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4cbd613bc7433b92f10bc098604379'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.721809 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4cbd613bc7433b92f10bc098604379'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.722461 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4cbd613bc7433b92f10bc098604379'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.723051 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8f399043-c4d9-47af-9161-2a27d59676f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4cbd613bc7433b92f10bc098604379'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:45.741247 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1418/2838] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:45 2022] DELETE /identity/v3/users/dc4cbd613bc7433b92f10bc098604379 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:46.028494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.030015 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:46.044585 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ca10-5224-4902-b28b-7176c34566fa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.104132 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.104695 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.104978 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.105237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] PATH_INFO: `/v3/projects/913f241639a046dab73be5c02369c57e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.106365 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913f241639a046dab73be5c02369c57e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.108349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.144563 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:46.168315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913f241639a046dab73be5c02369c57e', 'request_id': 'req-f92af61c-adbd-45ef-b450-df5d4e042427'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:46.176982 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913f241639a046dab73be5c02369c57e', 'request_id': 'req-f92af61c-adbd-45ef-b450-df5d4e042427'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:46.182831 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913f241639a046dab73be5c02369c57e', 'request_id': 'req-f92af61c-adbd-45ef-b450-df5d4e042427'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:46.195165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] The token cache is being invalidate because project 913f241639a046dab73be5c02369c57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:46.195495 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:46.196215 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f92af61c-adbd-45ef-b450-df5d4e042427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:46.197810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1421/2839] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:46 2022] DELETE /identity/v3/projects/913f241639a046dab73be5c02369c57e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:46.203880 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.204411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.204411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.226550 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:46.227818 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:46.297350 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1419/2840] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:46.306924 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.307244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.307498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.329273 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:46.330491 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:46.338848 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1422/2841] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:46.344178 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.357812 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f10c-16a8-4e4d-acef-4429f8f0150a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.363516 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.364470 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.364745 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.365015 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.365686 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:34:46.365985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.367664 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.380009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1420/2842] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:34:46.384406 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.394691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73ffd-5f2d-4649-91e8-956e8401e56d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.403539 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.404514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.404946 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.405286 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.406265 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.409347 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.447159 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1423/2843] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:46.453498 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.465211 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b63de-8957-4773-96b0-acf455a309f7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.497621 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:46.533269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.533888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.534161 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.534424 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.535039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.537025 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.562117 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1421/2844] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:46.568462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.582467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1843af-862d-4124-ba6a-1f47a9627589 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.588546 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.589283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.589707 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.590960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.590960 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.592989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.604690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1424/2845] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:46.610446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.621746 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a6b2a-39df-4494-a407-b3e63be689a3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.628251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.628860 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.629129 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.629392 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.630033 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.631749 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10868662-2227-4870-af52-f3e4225ff649 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.643681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1422/2846] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 05:34:46.648214 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.659814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef964-ea38-40fa-b45b-1d580876f178 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.665625 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.666275 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.666545 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.666820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] PATH_INFO: `/v3/projects/01ed7715c13e48658f8b920f01fd354e/users/bdd4a11e9c2c49c6a68ac93f0d30569b/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.682518 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ed7715c13e48658f8b920f01fd354e, user_id=bdd4a11e9c2c49c6a68ac93f0d30569b, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.685235 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.700477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1425/2847] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:46 2022] PUT /identity/v3/projects/01ed7715c13e48658f8b920f01fd354e/users/bdd4a11e9c2c49c6a68ac93f0d30569b/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:46.711127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.711477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.711774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.742511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] MFA Rules not processed for user `bdd4a11e9c2c49c6a68ac93f0d30569b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:46.743775 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:46.815827 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1423/2848] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:46.820465 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.885208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c18-8970-49df-9f1a-fe464561280a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:46.890297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:46.890907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:46.891188 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:46.891489 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:46.892126 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:46.894037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:46.927928 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1426/2849] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:46.932399 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:46.943943 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb281fb-262e-4f76-a25a-aeb552be72a3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.003405 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.004018 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.004297 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.004571 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.005187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.007130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.029889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1424/2850] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:46 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:47.034095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.044452 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a676-6d9d-4d85-9b7a-77bb4cc2cc44 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.050171 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.050785 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.051060 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.051362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.052008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.053659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.066064 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1427/2851] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:47.070938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.081572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a5e5-13eb-45eb-b695-23e57c9d5327 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.087616 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.088279 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.088557 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.088823 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] PATH_INFO: `/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1/users/17176247753c4793965c26eb578ec96b/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.103920 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bef2fb05f04e0db8c6bd8ecfe96ae1, user_id=17176247753c4793965c26eb578ec96b, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.106587 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.122824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1425/2852] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:47 2022] PUT /identity/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1/users/17176247753c4793965c26eb578ec96b/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:47.127066 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.137477 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c935-17e1-4145-8c91-953138fd2150 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.158989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:47.199881 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.200493 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.200766 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.201033 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.201672 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.203582 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e4b6-903f-43d7-af9f-8ef698ea91b5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.213910 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1428/2853] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:47.218723 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.224631 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:47.230889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906eda-afe2-42b8-bf21-7fd18849b5a1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.238036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.238754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.239389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.239682 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] PATH_INFO: `/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1/users/17176247753c4793965c26eb578ec96b/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.241678 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bef2fb05f04e0db8c6bd8ecfe96ae1, user_id=17176247753c4793965c26eb578ec96b, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.244415 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.257059 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1426/2854] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:47 2022] PUT /identity/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1/users/17176247753c4793965c26eb578ec96b/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:47.267730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.268017 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.268315 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.298862 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] MFA Rules not processed for user `17176247753c4793965c26eb578ec96b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:47.300141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:47.372212 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1429/2855] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:47.385055 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.387241 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:47.449640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ae00-fc53-40e5-b247-d791fdb29e0c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.453847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.454453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.454729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.454994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.464672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.466138 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.476382 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1427/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:47.530548 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:47.532331 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:47.544989 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b769f-412f-4494-b546-b55c827dffeb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:47.549155 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:47.549752 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:47.550023 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:47.550299 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:47.618194 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:47.619676 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b239b-6d8b-4655-aaee-680e0c7edba1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:47.628797 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1430/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:51.068608 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:51.136070 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47923f-0f52-4229-9f48-815cedbf1cab service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:51.140924 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:51.141854 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:51.142127 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:51.142395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] PATH_INFO: `/v3/users/bdd4a11e9c2c49c6a68ac93f0d30569b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:51.143614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd4a11e9c2c49c6a68ac93f0d30569b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:51.145567 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:51.197739 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd4a11e9c2c49c6a68ac93f0d30569b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.210122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd4a11e9c2c49c6a68ac93f0d30569b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.217008 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd4a11e9c2c49c6a68ac93f0d30569b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.217722 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd4a11e9c2c49c6a68ac93f0d30569b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.218383 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd4a11e9c2c49c6a68ac93f0d30569b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.239733 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1428/2858] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:51 2022] DELETE /identity/v3/users/bdd4a11e9c2c49c6a68ac93f0d30569b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:51.244633 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:51.245148 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:51.245261 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:51.264624 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:51.265919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:51.310457 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:51.331416 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1431/2859] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:51.342773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:51.344377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:51.358509 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:51.406758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d11fd-1047-4cf9-bcd9-499bcaca0b26 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:51.411569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:51.412176 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:51.412447 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:51.412707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:51.423359 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:51.424814 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:51.435163 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1429/2860] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:51.721076 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:51.722584 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:51.734974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07cc5d-c752-47fe-bd96-937e473ed421 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:51.740516 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:51.741165 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:51.741444 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:51.741717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] PATH_INFO: `/v3/projects/01ed7715c13e48658f8b920f01fd354e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:51.742918 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ed7715c13e48658f8b920f01fd354e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:51.744959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:51.794733 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ed7715c13e48658f8b920f01fd354e', 'request_id': 'req-437260c6-ec6d-4e88-a448-8407518a42a1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.804008 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ed7715c13e48658f8b920f01fd354e', 'request_id': 'req-437260c6-ec6d-4e88-a448-8407518a42a1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.810039 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ed7715c13e48658f8b920f01fd354e', 'request_id': 'req-437260c6-ec6d-4e88-a448-8407518a42a1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.821948 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] The token cache is being invalidate because project 01ed7715c13e48658f8b920f01fd354e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:51.822241 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.822907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.824475 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1432/2861] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:51 2022] DELETE /identity/v3/projects/01ed7715c13e48658f8b920f01fd354e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:51.828707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:51.839034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd13c-d862-4431-adc0-70048e4226cd service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:51.899923 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:51.900553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:51.900828 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:51.901095 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] PATH_INFO: `/v3/users/17176247753c4793965c26eb578ec96b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:51.902223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17176247753c4793965c26eb578ec96b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:51.904250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:51.955917 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17176247753c4793965c26eb578ec96b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.967788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17176247753c4793965c26eb578ec96b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.975801 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17176247753c4793965c26eb578ec96b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.976546 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17176247753c4793965c26eb578ec96b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.977269 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-be8ef87c-a314-4173-8f41-f3b4b15b760b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17176247753c4793965c26eb578ec96b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:51.993786 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1430/2862] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:51 2022] DELETE /identity/v3/users/17176247753c4793965c26eb578ec96b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:52.284641 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.286244 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:52.301559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437260c6-ec6d-4e88-a448-8407518a42a1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.362293 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.362952 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.363268 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.363540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] PATH_INFO: `/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.365020 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bef2fb05f04e0db8c6bd8ecfe96ae1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.366974 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.420197 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bef2fb05f04e0db8c6bd8ecfe96ae1', 'request_id': 'req-ace0ff0e-abf2-40c3-af94-996d9fc8398b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:52.429005 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bef2fb05f04e0db8c6bd8ecfe96ae1', 'request_id': 'req-ace0ff0e-abf2-40c3-af94-996d9fc8398b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:52.434717 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bef2fb05f04e0db8c6bd8ecfe96ae1', 'request_id': 'req-ace0ff0e-abf2-40c3-af94-996d9fc8398b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:52.441907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:52.446996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] The token cache is being invalidate because project c5bef2fb05f04e0db8c6bd8ecfe96ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:52.447357 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:52.448175 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ace0ff0e-abf2-40c3-af94-996d9fc8398b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:52.449807 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1433/2863] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:52 2022] DELETE /identity/v3/projects/c5bef2fb05f04e0db8c6bd8ecfe96ae1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:52.455219 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.455717 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.455834 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.476217 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:52.477439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:52.509889 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:52.541773 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1431/2864] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:52.606410 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.606682 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.606951 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.629128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:52.630264 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:52.638891 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1434/2865] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:52.644244 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.659057 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db1ab7-eddf-4654-a704-d5d399e6d095 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.664893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.665552 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.665824 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.666110 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.666754 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:34:52.667050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.668713 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.680994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1432/2866] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:34:52.685513 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.695116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9fb0-2fe1-45d5-b1cc-7238dbc3653e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.700608 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.701213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.701488 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.701755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.702392 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.704340 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.742847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1435/2867] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:52 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:52.749857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.761169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffa39-35bd-4d2b-ae75-1210845e68f2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.828340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.829215 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.829542 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.829815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.830446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.832416 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.856257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1433/2868] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:52 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:52.860813 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.872051 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4938a0-ad70-47b4-b137-ac3c6bd8ccb4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.878263 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.878869 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.879227 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.879423 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.880088 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.881694 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.892581 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1436/2869] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:52.897187 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.912396 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb958-5234-48d1-9264-8490848e4118 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.920514 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.921478 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.921916 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.922397 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.923053 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.924750 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952b67-4ce9-473e-8b26-ede2b0782f7b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:52.936691 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1434/2870] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:52.941836 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:52.956853 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf79d-bbed-4e53-b200-5d8b842ee971 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:52.962386 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:52.963037 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:52.963344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:52.963613 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] PATH_INFO: `/v3/projects/9ceae035c1004e41ae37f65a561b00ac/users/9150692244744893b8570d6159891ad6/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:52.978571 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ceae035c1004e41ae37f65a561b00ac, user_id=9150692244744893b8570d6159891ad6, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:52.981248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.001280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1437/2871] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:52 2022] PUT /identity/v3/projects/9ceae035c1004e41ae37f65a561b00ac/users/9150692244744893b8570d6159891ad6/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:53.017174 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.017473 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.017740 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.047675 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] MFA Rules not processed for user `9150692244744893b8570d6159891ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:53.049032 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:53.118599 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1435/2872] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:53.123616 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.189181 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf783c-c46a-4adf-85cf-b497e7612f78 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.194579 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.195220 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.195505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.195769 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.196411 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.198349 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.228388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1438/2873] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:53 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:53.232895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.244997 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603219b9-00f1-47e0-a8bb-d2e3a40ae34b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.273113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:53.305062 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.305699 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.305961 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.306232 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.306877 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.308879 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.333042 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1436/2874] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:53 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:53.337280 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.348111 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69206955-2022-49ce-85b3-affd207378aa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.353621 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.354222 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.354494 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.354760 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.355440 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.357049 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.368309 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1439/2875] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:53.372595 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.383108 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74af46-3cfc-4cd6-954e-253de0f408d4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.388445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.389130 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.389400 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.389666 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] PATH_INFO: `/v3/projects/9caba98de2f24e08b7194a71c04083fd/users/288f6a7612174f52bb3217c831c4e5d2/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.405344 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caba98de2f24e08b7194a71c04083fd, user_id=288f6a7612174f52bb3217c831c4e5d2, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.408113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.424104 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1437/2876] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:53 2022] PUT /identity/v3/projects/9caba98de2f24e08b7194a71c04083fd/users/288f6a7612174f52bb3217c831c4e5d2/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:53.428120 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.438840 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1a44-ca68-4be8-b646-56fd08ede00d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.501014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.501632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.501907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.502172 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.502811 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.504441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f79c6-133c-4465-b9b8-1898ab6bc2dc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.514321 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1440/2877] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:53.518771 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.529707 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fff6e7-183c-4847-a875-77a79d6ffac1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.535558 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.536220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.536490 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.536755 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] PATH_INFO: `/v3/projects/9caba98de2f24e08b7194a71c04083fd/users/288f6a7612174f52bb3217c831c4e5d2/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.538888 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caba98de2f24e08b7194a71c04083fd, user_id=288f6a7612174f52bb3217c831c4e5d2, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.541652 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.555394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1438/2878] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:53 2022] PUT /identity/v3/projects/9caba98de2f24e08b7194a71c04083fd/users/288f6a7612174f52bb3217c831c4e5d2/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:53.567874 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.568186 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.568483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.581081 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:53.602540 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] MFA Rules not processed for user `288f6a7612174f52bb3217c831c4e5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:53.603758 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:53.673763 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1441/2879] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:53.685023 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.687052 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:53.751088 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7741a6-8fd3-4d37-b309-daab73dd5f0f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.755575 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.756173 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.756440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.756702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.767091 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.768929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.778950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1439/2880] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:53.858934 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:53.870326 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8d7e-0db8-4261-9595-ad53508502e2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:53.874877 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:53.875627 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:53.875907 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:53.876178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:53.933929 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:53.935432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe021-5b5c-4da4-b0df-7fe22695b101 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:53.944580 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1442/2881] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:58.144122 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:58.210494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea46f-7a09-49aa-9ab8-ca2cdfcccad0 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:58.215500 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:58.216131 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:58.216409 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:58.216701 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] PATH_INFO: `/v3/users/9150692244744893b8570d6159891ad6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:58.217808 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9150692244744893b8570d6159891ad6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:58.219784 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:58.252439 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:58.273153 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9150692244744893b8570d6159891ad6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.285188 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9150692244744893b8570d6159891ad6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.292813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9150692244744893b8570d6159891ad6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.293526 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9150692244744893b8570d6159891ad6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.294169 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9150692244744893b8570d6159891ad6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.311420 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1440/2882] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:58 2022] DELETE /identity/v3/users/9150692244744893b8570d6159891ad6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:58.317141 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:58.317709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:58.317709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:58.338469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:58.339864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:58.405391 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1443/2883] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:58.415578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:58.417099 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:58.480216 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a469-987e-439b-bc36-b849d8feb078 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:58.484592 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:58.485209 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:58.485499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:58.485759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:58.496034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:58.497488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:58.507172 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1441/2884] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:34:58.805290 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:58.806755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:58.819730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcded0-b238-4a42-8e9a-262e659b6652 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:58.824436 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:58.825094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:58.825417 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:58.825671 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] PATH_INFO: `/v3/projects/9ceae035c1004e41ae37f65a561b00ac` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:58.827012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ceae035c1004e41ae37f65a561b00ac)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:58.829138 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:58.857559 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:58.882356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ceae035c1004e41ae37f65a561b00ac', 'request_id': 'req-abef5c37-5d79-4d3b-80e9-091e20ac3b49'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.890258 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ceae035c1004e41ae37f65a561b00ac', 'request_id': 'req-abef5c37-5d79-4d3b-80e9-091e20ac3b49'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.895914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ceae035c1004e41ae37f65a561b00ac', 'request_id': 'req-abef5c37-5d79-4d3b-80e9-091e20ac3b49'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.906998 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] The token cache is being invalidate because project 9ceae035c1004e41ae37f65a561b00ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:58.907324 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.908058 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:58.909767 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1444/2885] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:58 2022] DELETE /identity/v3/projects/9ceae035c1004e41ae37f65a561b00ac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:58.914058 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:58.924089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0969d-e989-4c2a-a277-077ca045dc16 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:58.985268 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:58.985979 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:58.986152 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:58.986467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] PATH_INFO: `/v3/users/288f6a7612174f52bb3217c831c4e5d2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:58.987677 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288f6a7612174f52bb3217c831c4e5d2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:58.990017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.039973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288f6a7612174f52bb3217c831c4e5d2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.041113 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:59.054123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288f6a7612174f52bb3217c831c4e5d2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.060965 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288f6a7612174f52bb3217c831c4e5d2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.061640 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288f6a7612174f52bb3217c831c4e5d2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.062230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-3cc7b950-acd6-419c-b944-0c099ab48915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288f6a7612174f52bb3217c831c4e5d2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.076759 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1442/2886] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:34:58 2022] DELETE /identity/v3/users/288f6a7612174f52bb3217c831c4e5d2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:59.363507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.365512 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:59.379390 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5c37-5d79-4d3b-80e9-091e20ac3b49 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.438980 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.439761 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.440036 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.440306 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] PATH_INFO: `/v3/projects/9caba98de2f24e08b7194a71c04083fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.441552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9caba98de2f24e08b7194a71c04083fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.443501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.491116 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9caba98de2f24e08b7194a71c04083fd', 'request_id': 'req-9abc1416-6bae-428b-b080-add4fe48f632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.500338 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9caba98de2f24e08b7194a71c04083fd', 'request_id': 'req-9abc1416-6bae-428b-b080-add4fe48f632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.506071 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9caba98de2f24e08b7194a71c04083fd', 'request_id': 'req-9abc1416-6bae-428b-b080-add4fe48f632'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.517538 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] The token cache is being invalidate because project 9caba98de2f24e08b7194a71c04083fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:34:59.517833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.518587 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9abc1416-6bae-428b-b080-add4fe48f632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:34:59.520230 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1445/2887] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:34:59 2022] DELETE /identity/v3/projects/9caba98de2f24e08b7194a71c04083fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:59.525385 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.525915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.525915 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.547518 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:59.548861 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:59.613335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1443/2888] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:59.621617 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.621904 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.622178 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.643131 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:34:59.644379 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:34:59.653190 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1446/2889] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:34:59.657758 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.668086 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa235-8149-4583-bcd3-236771f7a879 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.673437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.674048 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.674368 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.674636 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.675361 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:34:59.675660 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.677280 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.689910 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1444/2890] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:34:59.694438 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.703739 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1de08-01db-43f1-ba53-0f60394513a0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.709022 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.709610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.709873 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.710147 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.710765 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.712693 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.742185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1447/2891] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:34:59 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:59.746251 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.756881 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7287-29ac-4205-84d7-33a0486c62b0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.817149 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.817761 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.818036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.818298 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.818929 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.820942 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.847594 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1445/2892] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:34:59 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:34:59.851909 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.862737 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90368c08-2308-40c7-908b-b210dc8260a0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.867915 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.868543 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.868814 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.869078 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.869716 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.871362 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.882150 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1448/2893] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:59.886180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.897453 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea12a6-067f-4af0-94cd-1bd8053bd1bf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.903417 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.904040 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.904313 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.904569 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.905220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.906846 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18209-fd4f-449a-ac6c-4e19081efb25 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.918346 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1446/2894] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:34:59.922577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:34:59.927916 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:34:59.933820 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115e0c1-781e-4f4f-8c93-4ba18455fcfe admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:34:59.939648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:34:59.940295 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.940567 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.940834 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] PATH_INFO: `/v3/projects/4da5e7ef921b4aab9ec1833020c36bb8/users/56d9e307e29843fda58f045b155c3502/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:34:59.955476 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da5e7ef921b4aab9ec1833020c36bb8, user_id=56d9e307e29843fda58f045b155c3502, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:34:59.958128 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:34:59.974026 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1449/2895] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:34:59 2022] PUT /identity/v3/projects/4da5e7ef921b4aab9ec1833020c36bb8/users/56d9e307e29843fda58f045b155c3502/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:34:59.985291 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:34:59.985669 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:34:59.986043 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.021494 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] MFA Rules not processed for user `56d9e307e29843fda58f045b155c3502`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:00.022603 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:00.041848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:00.089467 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1447/2896] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:00.094202 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.158788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c497-99ef-4cd0-b06a-637b7475ebda admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.164094 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.164703 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.164976 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.165248 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.165870 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.167838 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.201648 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1450/2897] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:35:00 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:35:00.207541 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.219036 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288274b-ddfc-43d3-9d53-1d4fe01a5f5f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.279661 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.280260 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.280527 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.280800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.281427 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.283414 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.308039 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1448/2898] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:35:00 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:35:00.313827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.326032 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400855-0424-40e6-8578-49d2023b628a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.331629 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.332270 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.332541 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.332810 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.333454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.335053 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.346434 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1451/2899] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:00.350738 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.361503 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43095-bed1-4d22-855c-59389d60d00b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.368150 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.368813 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.369089 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.369354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] PATH_INFO: `/v3/projects/7de6288245e74e92bda85b221b456496/users/070496d1fd834265bd530f3986d72c4e/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.389322 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de6288245e74e92bda85b221b456496, user_id=070496d1fd834265bd530f3986d72c4e, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.393789 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.411213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1449/2900] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:35:00 2022] PUT /identity/v3/projects/7de6288245e74e92bda85b221b456496/users/070496d1fd834265bd530f3986d72c4e/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:00.415243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.425888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ebd6f-55a0-4765-b38c-f6dbb9833b5d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.484701 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.485317 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.485594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.485864 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.486481 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.488577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fc37-538d-4473-88cd-411c9dcb5043 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.498740 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1452/2901] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:00.503137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.513613 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc22b-9326-4d82-8036-37d4de2c6f42 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.518655 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.519331 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.519607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.519871 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] PATH_INFO: `/v3/projects/7de6288245e74e92bda85b221b456496/users/070496d1fd834265bd530f3986d72c4e/roles/043be44598c24b52b429eb2a25c1962d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.522003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de6288245e74e92bda85b221b456496, user_id=070496d1fd834265bd530f3986d72c4e, role_id=043be44598c24b52b429eb2a25c1962d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.524731 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.534951 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1450/2902] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:35:00 2022] PUT /identity/v3/projects/7de6288245e74e92bda85b221b456496/users/070496d1fd834265bd530f3986d72c4e/roles/043be44598c24b52b429eb2a25c1962d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:35:00.546602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.546883 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.547154 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.578237 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] MFA Rules not processed for user `070496d1fd834265bd530f3986d72c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:00.579497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:00.621399 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:00.654734 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1453/2903] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 05:35:00.666712 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.668564 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:00.730572 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23bc7-9b9e-4590-8469-687f1f8ee374 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.734708 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.735354 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.735639 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.735897 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.745849 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.747326 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.757604 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1451/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:00.851710 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:00.863852 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43a9f-df8c-4464-9fce-cf21a156dd26 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:00.868736 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:00.869352 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:00.869632 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:00.869902 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:00.934232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:00.936031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47fad1-1554-4457-9c2b-6d1797df1096 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:00.945730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1454/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:01.223762 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:01.242479 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:01.302230 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52de04-7afd-45db-ac23-13df86d10be9 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:01.307395 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:01.308034 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:01.308308 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:01.308574 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] PATH_INFO: `/v3/users/56d9e307e29843fda58f045b155c3502` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:01.309729 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d9e307e29843fda58f045b155c3502)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:01.311719 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:01.377830 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d9e307e29843fda58f045b155c3502'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.392505 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d9e307e29843fda58f045b155c3502'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.399994 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d9e307e29843fda58f045b155c3502'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.400702 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d9e307e29843fda58f045b155c3502'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.401327 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d9e307e29843fda58f045b155c3502'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.417080 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1452/2906] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:35:01 2022] DELETE /identity/v3/users/56d9e307e29843fda58f045b155c3502 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:01.422533 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:01.423353 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:01.423456 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:01.449507 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:01.450730 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:01.514844 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1455/2907] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:01.525252 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:01.526760 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:01.585358 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7885b-c06e-4ec0-be93-c7409dbba529 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:01.591445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:01.592321 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:01.592653 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:01.593017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:01.604488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:01.605938 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:01.616123 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1453/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 05:35:01.897892 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:01.899586 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:01.913344 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aebf4-b969-45b9-aecc-1e896c0f3792 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:01.918640 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:01.919333 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:01.919610 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:01.919882 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] PATH_INFO: `/v3/projects/4da5e7ef921b4aab9ec1833020c36bb8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:01.921031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da5e7ef921b4aab9ec1833020c36bb8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:01.923001 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:01.973441 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da5e7ef921b4aab9ec1833020c36bb8', 'request_id': 'req-503989aa-360b-42b4-b297-1890d3343853'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.982691 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da5e7ef921b4aab9ec1833020c36bb8', 'request_id': 'req-503989aa-360b-42b4-b297-1890d3343853'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.989014 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da5e7ef921b4aab9ec1833020c36bb8', 'request_id': 'req-503989aa-360b-42b4-b297-1890d3343853'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:01.991239 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:02.002498 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] The token cache is being invalidate because project 4da5e7ef921b4aab9ec1833020c36bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:35:02.002842 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.004057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.006473 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1456/2909] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:35:01 2022] DELETE /identity/v3/projects/4da5e7ef921b4aab9ec1833020c36bb8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:02.010693 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.022946 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0804fe5-0453-4c3e-ab96-caf770090a06 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:02.061213 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:02.088764 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:02.089645 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.090022 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.090472 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] PATH_INFO: `/v3/users/070496d1fd834265bd530f3986d72c4e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.092240 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070496d1fd834265bd530f3986d72c4e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:02.095250 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:02.148335 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070496d1fd834265bd530f3986d72c4e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.160689 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070496d1fd834265bd530f3986d72c4e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.167950 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070496d1fd834265bd530f3986d72c4e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.168659 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070496d1fd834265bd530f3986d72c4e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.169274 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-843b461e-867f-4776-9ad0-5c5a34ac16e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070496d1fd834265bd530f3986d72c4e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.184893 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1454/2910] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:35:02 2022] DELETE /identity/v3/users/070496d1fd834265bd530f3986d72c4e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:02.478497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.480031 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:02.493945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503989aa-360b-42b4-b297-1890d3343853 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:02.551372 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:02.552012 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.552287 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.552552 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] PATH_INFO: `/v3/projects/7de6288245e74e92bda85b221b456496` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.553697 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de6288245e74e92bda85b221b456496)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:02.555675 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:02.610388 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de6288245e74e92bda85b221b456496', 'request_id': 'req-b69eae80-198f-4341-9359-2eee7f1dcbd2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.621888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de6288245e74e92bda85b221b456496', 'request_id': 'req-b69eae80-198f-4341-9359-2eee7f1dcbd2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.627554 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de6288245e74e92bda85b221b456496', 'request_id': 'req-b69eae80-198f-4341-9359-2eee7f1dcbd2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.638602 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] The token cache is being invalidate because project 7de6288245e74e92bda85b221b456496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:35:02.638888 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.639596 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b69eae80-198f-4341-9359-2eee7f1dcbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:02.641307 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1457/2911] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:35:02 2022] DELETE /identity/v3/projects/7de6288245e74e92bda85b221b456496 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:02.646857 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.647389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.647389 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.668452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:02.669650 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:02.733632 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1455/2912] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:02.744118 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.744405 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.744680 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.766168 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:02.767462 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:02.777185 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1458/2913] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:02.781665 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.791862 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996f5e-f20e-43a0-8199-9d832d6ac5c3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:02.797466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:02.798071 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.798340 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.798607 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.799276 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:35:02.799586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:02.801223 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:02.813434 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1456/2914] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:35:02.819356 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.828715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5739b-ad1a-415b-8b43-c75861e786bc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:02.834400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:02.835003 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.835342 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.835614 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.836243 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:02.838160 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:02.875572 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1459/2915] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:35:02 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:35:02.881120 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.892081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57732-5218-4f95-a495-98ed01fb74ac admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:02.939436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:02.956496 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:02.957267 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:02.957548 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:02.957820 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:02.958451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:02.960446 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:02.984477 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1457/2916] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:35:02 2022] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:35:02.988863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:02.999755 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5e702-0beb-4600-9ce1-d504716a91eb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.004483 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.005090 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.005368 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.005639 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.006325 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.007959 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.017981 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1460/2917] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:03.021988 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:03.032081 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b2f86-58c7-405f-ab67-3da4245c5d9b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.037017 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.037644 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.037919 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.038182 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.038815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.040469 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ec2d-d85f-4b40-8598-94df7f583b50 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.051003 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1458/2918] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:03.055187 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:03.065594 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ab0-3216-4d41-93ae-930658c1344a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.071863 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.072521 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.072780 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.073073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] PATH_INFO: `/v3/projects/644f6bb20b91453290695669319aaa88/users/6672da6fecda49bfa0e8780fc260a381/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.088898 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644f6bb20b91453290695669319aaa88, user_id=6672da6fecda49bfa0e8780fc260a381, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.091646 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.107709 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1461/2919] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:35:03 2022] PUT /identity/v3/projects/644f6bb20b91453290695669319aaa88/users/6672da6fecda49bfa0e8780fc260a381/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:03.120973 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.121258 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.121545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.153676 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] MFA Rules not processed for user `6672da6fecda49bfa0e8780fc260a381`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:03.154802 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:03.231191 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1459/2920] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:03.265927 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:03.267833 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:03.295430 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:03.330845 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1902-f4cd-4156-b111-c3262b6be412 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.334996 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.335634 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.335917 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.336189 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.344889 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.346329 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0623b-e4c3-4d40-82b9-7905d9ac7560 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.355256 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1462/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:03.371872 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:03.438633 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec1eb-4acd-4d34-80d3-0912babe34cf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.444515 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.445147 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.445436 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.445697 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] PATH_INFO: `/v3/users/6672da6fecda49bfa0e8780fc260a381` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.446939 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6672da6fecda49bfa0e8780fc260a381)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.448922 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.503437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6672da6fecda49bfa0e8780fc260a381'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:03.508899 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:03.517796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6672da6fecda49bfa0e8780fc260a381'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:03.525299 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6672da6fecda49bfa0e8780fc260a381'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:03.525974 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6672da6fecda49bfa0e8780fc260a381'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:03.526580 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6672da6fecda49bfa0e8780fc260a381'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:03.540448 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1460/2922] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:35:03 2022] DELETE /identity/v3/users/6672da6fecda49bfa0e8780fc260a381 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:03.545173 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.545687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.545687 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.564809 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:03.566104 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:03.628193 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1463/2923] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:03.638394 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:03.639970 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:03.698499 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a83f2-df0b-47f0-84b2-f7c557d43a10 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:03.703788 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:03.704406 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:03.704681 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:03.704947 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:03.716137 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:03.717593 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874939-6fef-40d7-89bb-9399300e28e9 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:03.727536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1461/2924] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:04.009099 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.010659 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:04.025514 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dcaa7-9af4-4cb3-a4ec-3443d4efb905 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.030566 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.031232 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.031520 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.032562 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] PATH_INFO: `/v3/projects/644f6bb20b91453290695669319aaa88` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.033057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=644f6bb20b91453290695669319aaa88)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.035631 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.092006 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644f6bb20b91453290695669319aaa88', 'request_id': 'req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:04.102467 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644f6bb20b91453290695669319aaa88', 'request_id': 'req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:04.108454 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644f6bb20b91453290695669319aaa88', 'request_id': 'req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:04.120073 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] The token cache is being invalidate because project 644f6bb20b91453290695669319aaa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:35:04.120367 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:04.120984 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-93fcc05d-c0de-4232-8b62-4d5b01d04d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:04.122497 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1464/2925] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:35:04 2022] DELETE /identity/v3/projects/644f6bb20b91453290695669319aaa88 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:35:04.127705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.127987 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.128256 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.149774 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:04.150981 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:04.217842 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1462/2926] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:04.226095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.226381 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.226643 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.248288 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:04.249505 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:04.260384 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1465/2927] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:04.264732 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.274796 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b0bcf-9d65-4e12-a9d3-4fb0058aeeef None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.279672 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.280302 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.280578 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.280847 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.281493 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 05:35:04.281792 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.283443 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.295144 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1463/2928] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Sep 2 05:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 05:35:04.299609 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.309250 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a63a-a33b-48ae-9f22-db604f629730 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.314024 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.314645 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.314919 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.315184 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.315866 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.318069 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.348788 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1466/2929] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Sep 2 05:35:04 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 05:35:04.353220 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.363614 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c781af-d860-4497-a00c-ab877b7b9745 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.429658 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.430586 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.431009 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.431451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.432452 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.435530 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.447423 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:04.468536 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1464/2930] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Sep 2 05:35:04 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 05:35:04.472839 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.484027 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8315-db81-42d7-8b54-334e81951f2d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.489050 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.490034 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.490314 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.490668 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.491341 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.492957 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.503504 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1467/2931] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:04.507545 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.518194 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fa87b-8a5e-4c23-b7bf-54eb4033bbf1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.523553 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.524158 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.524437 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.524704 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.525377 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.526996 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9b3e-3caa-48a0-b0d4-7e255636feb9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.538466 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1465/2932] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Sep 2 05:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 05:35:04.542715 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.553112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36682a0f-b33d-4f0d-877f-6a08fce26433 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.557914 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.558556 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.558827 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.559095 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] PATH_INFO: `/v3/projects/b4b70167de314ce79c5ea3816fb65e95/users/f69cacb66c524c05bd03133a2c7e8141/roles/2b0f7dcbac564f0cab3167129879b22f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.562242 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:04.574999 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b70167de314ce79c5ea3816fb65e95, user_id=f69cacb66c524c05bd03133a2c7e8141, role_id=2b0f7dcbac564f0cab3167129879b22f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.577819 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.593213 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1468/2933] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Sep 2 05:35:04 2022] PUT /identity/v3/projects/b4b70167de314ce79c5ea3816fb65e95/users/f69cacb66c524c05bd03133a2c7e8141/roles/2b0f7dcbac564f0cab3167129879b22f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:04.605671 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.605960 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.606221 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.635695 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] MFA Rules not processed for user `f69cacb66c524c05bd03133a2c7e8141`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:04.636933 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:04.707848 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1466/2934] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:04.719297 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:04.721208 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:04.794644 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317fef3-774d-4358-b1d2-fee2f89e1867 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:04.799057 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c891710c74ca4a4dae183c7979152109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:04.799708 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:04.799987 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:04.800254 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:04.809988 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:04.811469 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795acdf-d960-4ed9-87bf-042709692cce service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:04.820651 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1469/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:14.705180 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:14.816690 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:15.132451 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:15.200050 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d707d-344b-4f56-94b4-82ce4b8c64e8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:15.205111 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:15.205748 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:15.206044 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:15.206307 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] PATH_INFO: `/v3/users/f69cacb66c524c05bd03133a2c7e8141` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:15.207497 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69cacb66c524c05bd03133a2c7e8141)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:15.209471 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:15.261511 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69cacb66c524c05bd03133a2c7e8141'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.276800 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69cacb66c524c05bd03133a2c7e8141'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.284705 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69cacb66c524c05bd03133a2c7e8141'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.285475 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69cacb66c524c05bd03133a2c7e8141'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.286143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69cacb66c524c05bd03133a2c7e8141'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.301411 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1467/2936] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Sep 2 05:35:15 2022] DELETE /identity/v3/users/f69cacb66c524c05bd03133a2c7e8141 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 05:35:15.306112 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:15.306400 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:15.306678 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:15.326577 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] MFA Rules not processed for user `1444fa15af784a62ae966718f3a66e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 05:35:15.327826 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:15.388432 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1470/2937] 10.222.0.26 () {58 vars in 958 bytes} [Fri Sep 2 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 05:35:15.398170 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:15.399716 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:15.469925 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e5b8-4963-4f0a-a2d8-483737aef4ea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:15.474218 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8d5b7a906244a9997fcabc92b00e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:15.474866 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:15.475143 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:15.475445 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:15.486115 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:15.487622 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:15.497895 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1468/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:35:15.768860 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:35:15.770945 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:35:15.786968 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626070b-f9a6-4040-b2a9-91e109f56cde None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:35:15.793906 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1444fa15af784a62ae966718f3a66e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a94747b8f64b12a67048c396b7c9c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:35:15.794501 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:35:15.794776 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:35:15.795043 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] PATH_INFO: `/v3/projects/b4b70167de314ce79c5ea3816fb65e95` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:35:15.796283 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b70167de314ce79c5ea3816fb65e95)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:35:15.798205 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:35:15.846403 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b70167de314ce79c5ea3816fb65e95', 'request_id': 'req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.854861 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b70167de314ce79c5ea3816fb65e95', 'request_id': 'req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.860847 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b70167de314ce79c5ea3816fb65e95', 'request_id': 'req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.873319 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] The token cache is being invalidate because project b4b70167de314ce79c5ea3816fb65e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 05:35:15.873612 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.874363 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9cab1931-fdb1-4d1b-a908-8d5c8f74b5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 05:35:15.876025 dv-cinder-853910-7-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1471/2939] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Sep 2 05:35:15 2022] DELETE /identity/v3/projects/b4b70167de314ce79c5ea3816fb65e95 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 05:35:25.493560 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:35:25.870578 dv-cinder-853910-7-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 05:36:35.562488 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 05:36:35.564941 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:36:35.639815 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795ab5-d91f-406b-ad5e-66968b90833c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 05:36:35.714403 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f966288c77849f1b591bd3fc8fbd8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1920309f691847578cad8f735480b42c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 05:36:35.715257 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 05:36:35.715646 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 05:36:35.715992 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 05:36:35.719160 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 05:36:35.732440 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 05:36:35.733985 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a0b7-b467-414b-a4aa-1fbfa353f326 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 05:36:35.744751 dv-cinder-853910-7-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1469/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Sep 2 05:36:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 05:36:45.739914 dv-cinder-853910-7-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=58 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}